00000001:02000400:3.0F:1789081374.644312:0:2954:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg117-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1789081398.784501:0:3179:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg117-server.virtnet: executing load_modules_local 00000001:01000000:0.0:1789081401.180703:0:3223:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 503 MB/s 00000001:01000000:2.0F:1789081401.435501:0:3223:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 574 MB/s 00000001:01000000:2.0:1789081401.685563:0:3223:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3155 MB/s 00000020:02000000:3.0:1789081402.661644:0:3272:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.55_25_gfa4fa99 00000400:02000000:0.0:1789081403.936551:0:3287:0:(api-ni.c:2766:lnet_startup_lndni()) Added LNI 192.168.201.117@tcp [8/256/0/180] 00008000:02000000:1.0F:1789081408.744379:0:3437:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1789081471.346282:0:5244:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg117-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789081481.865882:0:5770:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789081481.865887:0:5770:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1789081481.866037:0:5770:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 0000000070b59caa 00000080:02000400:0.0:1789081481.866050:0:5770:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1789081481.876560:0:5770:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1789081481.876580:0:5770:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1789081481.876631:0:5770:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000007f1ce10e) 00000020:00000080:0.0:1789081481.876658:0:5770:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789081481.908276:0:5770:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1789081481.909290:0:5770:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1789081481.958023:0:5770:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789081481.958068:0:5770:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789081481.958090:0:5770:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789081481.958143:0:5770:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789081481.958170:0:5770:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789081481.959395:0:5770:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789081481.959410:0:5770:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789081481.959820:0:5770:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb7cb3d7479d5f402 00000020:01000004:3.0:1789081481.959833:0:5770:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1789081481.959841:0:5770:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789081481.959851:0:5770:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000070b59caa from MGS 00000020:01000004:3.0:1789081481.959858:0:5770:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789081481.959905:0:5770:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000c583498e) 00000020:00000080:3.0:1789081481.959926:0:5770:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789081481.960216:0:5770:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000070b59caa from MGS, refs=2 00080000:01000000:3.0:1789081481.960222:0:5770:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789081481.960228:0:5770:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb7cb3d7479d5f410 00000100:00100000:3.0:1789081481.960650:0:5770:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789081481.960799:0:5770:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789081481.960806:0:5770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789081481.963726:0:5770:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789081481.963749:0:5770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789081481.965723:0:5770:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789081481.967392:0:5770:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789081481.967410:0:5770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789081481.969751:0:5770:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789081481.969768:0:5770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789081481.972343:0:5770:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789081481.972716:0:5770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1789081481.973835:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081481.973841:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081481.973842:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081481.974239:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081481.974242:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081481.974249:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081481.975076:0:5770:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789081481.985373:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1789081482.224887:0:5770:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2139 MB/s 00000001:01000000:3.0:1789081482.474656:0:5770:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2735 MB/s 00000001:01000000:1.0:1789081482.724577:0:5770:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 491 MB/s 00000001:01000000:3.0:1789081482.977450:0:5770:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 519 MB/s 00080000:10000000:2.0:1789081483.002510:0:5770:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:1.0:1789081483.037851:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789081483.053011:0:5770:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1789081483.053038:0:5770:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789081483.053041:0:5770:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1789081483.059109:0:5780:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789081483.059803:0:5770:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789081483.059897:0:5770:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1789081483.060206:0:5770:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1789081483.060261:0:5770:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789081483.060788:0:5770:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789081483.061019:0:5770:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789081483.061030:0:5770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789081483.063243:0:5770:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789081483.063260:0:5770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789081483.074054:0:5770:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789081483.074076:0:5770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789081483.078012:0:5770:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789081483.078048:0:5770:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.117@tcp' 00000020:01000004:3.0:1789081483.078050:0:5770:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789081483.078116:0:5770:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.117@tcp (typ=mgc) 00000020:00000080:3.0:1789081483.078132:0:5770:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.117@tcp (0000000063b109c4) 00000020:00000080:3.0:1789081483.078153:0:5770:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789081483.078256:0:5770:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000061cbf2fe@MGC192.168.201.117@tcp: add connection 192.168.201.117@tcp at head 00010000:00010000:3.0:1789081483.078520:0:5770:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.117@tcp-0 is initialized 00000100:00080000:2.0:1789081483.078685:0:5785:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000040:01000000:3.0:1789081483.078928:0:5770:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.117@tcp ctxt 1 is initialized 10000000:01000000:0.0:1789081483.085348:0:5786:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789081483.085468:0:5770:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.117@tcp (uuid ee551687-7675-4fc6-9be1-2ccb62bdd809) 00000020:00000080:3.0:1789081483.085562:0:5770:0:(genops.c:1406:class_connect()) connect: client ee551687-7675-4fc6-9be1-2ccb62bdd809, cookie 0xb7cb3d7479d5f41e 00000100:00080000:3.0:1789081483.085586:0:5770:0:(import.c:510:import_select_connection()) MGC192.168.201.117@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789081483.085594:0:5770:0:(import.c:624:import_select_connection()) MGC192.168.201.117@tcp: import 0000000061cbf2fe using connection 192.168.201.117@tcp/0@lo 00000100:00100000:3.0:1789081483.086098:0:5770:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000bfc79026 x1875987821232256/t0(0) o250->MGC192.168.201.117@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789081483.086133:0:5770:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import ee551687-7675-4fc6-9be1-2ccb62bdd809->MGS 00000020:01000004:3.0:1789081483.086162:0:5770:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789081483.086192:0:5770:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789081483.086208:0:5770:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000a836396d) 00000020:00000080:3.0:1789081483.086222:0:5770:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789081483.087897:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bfc79026 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ee551687-7675-4fc6-9be1-2ccb62bdd809:3302:1875987821232256:0@lo:250: 00000100:00100000:0.0:1789081483.088027:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081483.088127:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821232256 00000100:00100000:2.0:1789081483.088148:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821232256 00000100:00100000:2.0:1789081483.088233:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789081483.088243:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b53a2f4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3302:x1875987821232256:12345-0@lo:250: 00010000:00080000:2.0:1789081483.088286:0:5782:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from ee551687-7675-4fc6-9be1-2ccb62bdd809@0@lo t0 exp 0000000000000000 cur 149 last 0 00000020:00000080:2.0:1789081483.088321:0:5782:0:(genops.c:1406:class_connect()) connect: client ee551687-7675-4fc6-9be1-2ccb62bdd809, cookie 0xb7cb3d7479d5f42c 00000100:00080000:2.0:1789081483.088614:0:5782:0:(import.c:65:import_set_state_nolock()) 00000000f7ad3657 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789081483.088888:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b53a2f4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+5:3302:x1875987821232256:12345-0@lo:250: Request processed in 644us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081483.088898:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789081483.089288:0:3302:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.201.117@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789081483.089306:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.117@tcp: connect to target with instance 0 00000100:00080000:0.0:1789081483.089316:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.117@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789081483.089322:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789081483.089327:0:3302:0:(import.c:65:import_set_state_nolock()) 0000000061cbf2fe MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789081483.089332:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789081483.089358:0:3302:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789081483.089368:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bfc79026 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ee551687-7675-4fc6-9be1-2ccb62bdd809:3302:1875987821232256:0@lo:250: 00000100:00100000:2.0:1789081483.130395:0:5770:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789081483.132177:0:5770:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789081483.132188:0:5770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789081483.135722:0:5770:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789081483.135738:0:5770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1789081483.136414:0:5770:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1789081483.136422:0:5770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789081483.153347:0:5770:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789081483.153630:0:5770:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789081483.153647:0:5770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1789081483.154471:0:5770:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789081483.154489:0:5770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789081483.397980:0:5770:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789081483.398238:0:5770:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789081483.398247:0:5770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789081483.402459:0:5770:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789081483.402488:0:5770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789081483.403773:0:5770:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789081483.403983:0:5770:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789081483.403990:0:5770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789081483.405311:0:5770:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789081483.405323:0:5770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789081483.407253:0:5770:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789081483.407515:0:5770:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789081483.407583:0:5770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789081483.413782:0:5770:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789081483.413808:0:5770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789081483.417376:0:5770:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789081483.417684:0:5770:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789081483.417691:0:5770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789081483.421180:0:5770:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789081483.421207:0:5770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1789081483.497914:0:5770:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789081483.498189:0:5770:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789081483.498197:0:5770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789081483.502758:0:5770:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789081483.502786:0:5770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789081483.504827:0:5770:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789081483.504849:0:5770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789081483.506422:0:5770:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789081483.506453:0:5770:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1789081483.506463:0:5770:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.117@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789081483.506981:0:5770:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.117@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789081483.507024:0:5770:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.117@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1789081483.507030:0:5770:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789081483.507031:0:5770:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789081483.507032:0:5770:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789081483.507034:0:5770:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789081483.507035:0:5770:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789081483.507036:0:5770:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789081483.507038:0:5770:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789081483.507039:0:5770:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789081483.507041:0:5770:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789081483.507042:0:5770:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789081483.507043:0:5770:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789081483.507044:0:5770:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789081483.507047:0:5770:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1789081483.507050:0:5770:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789081483.507051:0:5770:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789081483.507052:0:5770:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789081483.507053:0:5770:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789081483.507054:0:5770:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789081483.507055:0:5770:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789081483.507056:0:5770:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789081483.507057:0:5770:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789081483.507058:0:5770:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789081483.507059:0:5770:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789081483.507060:0:5770:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789081483.507061:0:5770:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789081483.507100:0:5770:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789081483.507120:0:5770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000076b00f01 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:5770:1875987821232384:0@lo:253: 00000100:00100000:0.0:1789081483.507213:0:5770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081483.507356:0:5770:0:(client.c:2702:ptlrpc_set_wait()) set 000000002b81a707 going to sleep for 11 seconds 00000100:00100000:3.0:1789081483.511264:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821232384 00000100:00100000:3.0:1789081483.511288:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821232384 00000100:00100000:3.0:1789081483.511412:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789081483.511423:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004a03d4d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+5:5770:x1875987821232384:12345-0@lo:253: 20000000:01000000:3.0:1789081483.511561:0:5784:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789081483.511565:0:5784:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1789081483.512249:0:5805:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789081483.512344:0:5784:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1789081483.512814:0:5784:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789081483.517221:0:5806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1789081483.518129:0:5784:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789081483.518138:0:5784:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1789081483.518147:0:5784:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1789081483.518152:0:5784:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1789081483.518171:0:5784:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1789081483.518563:0:5784:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789081483.519459:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1789081483.519497:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789081483.520370:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1789081483.520445:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1789081483.521173:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1789081483.521348:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1789081483.521359:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1789081483.521421:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1789081483.521430:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1789081483.521464:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1789081483.521484:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1789081483.521584:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1789081483.521651:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1789081483.521689:0:5784:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1789081483.521696:0:5784:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1789081483.521711:0:5784:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789081483.522270:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1789081483.522282:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789081483.522335:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1789081483.522373:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1789081483.522436:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1789081483.522450:0:5784:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1789081483.523275:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1789081483.523294:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789081483.523358:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1789081483.523395:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1789081483.523429:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1789081483.523446:0:5784:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1789081483.523954:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1789081483.523968:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1789081483.524010:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1789081483.524045:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1789081483.524247:0:5784:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1789081483.524303:0:5784:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1789081483.524311:0:5784:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1789081483.537394:0:5807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1789081483.538004:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1789081483.538039:0:5784:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.117@tcp for mdt 20000000:01000000:3.0:1789081483.538041:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.117@tcp (null) (null) (null) 00000040:00080000:3.0:1789081483.538078:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1789081483.538086:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789081483.538113:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1789081483.538120:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.117@tcp (null) (null) 00000040:00080000:3.0:1789081483.538210:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1789081483.538222:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1789081483.538258:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1789081483.538293:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1789081483.538360:0:5784:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789081483.538365:0:5784:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789081483.538379:0:5784:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1789081483.538387:0:5784:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1789081483.539984:0:5808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:2.0:1789081483.540150:0:5784:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1789081483.555972:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1789081483.556038:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:3.0:1789081483.556130:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:3.0:1789081483.556156:0:5784:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789081483.556159:0:5784:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789081483.556162:0:5784:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789081483.556178:0:5784:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789081483.556181:0:5784:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789081483.556215:0:5784:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789081483.556219:0:5784:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789081483.572496:0:5809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:0.0:1789081483.573336:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:0.0:1789081483.573390:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:0.0:1789081483.573487:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:0.0:1789081483.573503:0:5784:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789081483.573506:0:5784:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789081483.577141:0:5810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1789081483.577729:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1789081483.577784:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1789081483.577821:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1789081483.577850:0:5784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789081483.577853:0:5784:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:1.0:1789081483.577862:0:5784:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789081483.577887:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008a092c07/0xb7cb3d7479d5f433 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081483.577903:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008a092c07/0xb7cb3d7479d5f433 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081483.577913:0:5784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008a092c07/0xb7cb3d7479d5f433 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081483.577920:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008a092c07/0xb7cb3d7479d5f433 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081483.577925:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008a092c07/0xb7cb3d7479d5f433 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081483.577932:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008a092c07/0xb7cb3d7479d5f433 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081483.577938:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008a092c07 already unused, calling callback (000000004b47f47c) 00010000:00010000:1.0:1789081483.577941:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008a092c07/0xb7cb3d7479d5f433 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081483.577948:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008a092c07/0xb7cb3d7479d5f433 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081483.577960:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008a092c07/0xb7cb3d7479d5f433 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081483.577968:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008a092c07/0xb7cb3d7479d5f433 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081483.577983:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008a092c07/0xb7cb3d7479d5f433 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789081483.578001:0:5784:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789081483.953942:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004a03d4d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+5:5770:x1875987821232384:12345-0@lo:253: Request processed in 442509us (446716us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081483.953964:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789081483.954121:0:5770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000076b00f01 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:5770:1875987821232384:0@lo:253: 10000000:01000000:0.0:1789081483.954137:0:5770:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789081483.954140:0:5770:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789081483.954142:0:5770:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789081483.954143:0:5770:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789081483.954143:0:5770:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1789081483.954145:0:5770:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789081483.954145:0:5770:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789081483.954146:0:5770:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789081483.954147:0:5770:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789081483.954149:0:5770:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789081483.954150:0:5770:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789081483.954150:0:5770:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789081483.954168:0:5770:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000070b59caa from lustre-MDT0000 10000000:01000000:0.0:1789081483.954196:0:5770:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789081483.954198:0:5770:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789081483.954203:0:5770:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9e10d1a03380 10000000:01000000:0.0:1789081483.954207:0:5770:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789081483.954214:0:5770:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9e10d1a03380 from 1 10000000:01000000:0.0:1789081483.954218:0:5770:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789081483.954338:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: 00000000af953db8/0xb7cb3d7479d5f43a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081483.954347:0:5770:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: 00000000af953db8/0xb7cb3d7479d5f43a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081483.954354:0:5770:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: 00000000af953db8/0xb7cb3d7479d5f43a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081483.954390:0:5770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000076b00f01 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:5770:1875987821232512:0@lo:101: 00000100:00100000:0.0:1789081483.954426:0:5770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081483.954554:0:5770:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ceb3f1a9 going to sleep for 11 seconds 00000100:00100000:2.0:1789081483.957773:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821232512 00000100:00100000:2.0:1789081483.957794:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821232512 00000100:00100000:2.0:1789081483.957984:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789081483.957994:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006f89325 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+5:5770:x1875987821232512:12345-0@lo:101: 00010000:00010000:2.0:1789081483.958016:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081483.958040:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f02c28b6/0xb7cb3d7479d5f441 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f43a expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081483.958070:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f02c28b6/0xb7cb3d7479d5f441 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f43a expref: 6 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081483.958077:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f02c28b6/0xb7cb3d7479d5f441 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f43a expref: 6 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081483.958085:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f02c28b6, rc 0) 00000100:00100000:2.0:1789081483.958175:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006f89325 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+6:5770:x1875987821232512:12345-0@lo:101: Request processed in 184us (3748us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081483.958180:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789081483.958309:0:5770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000076b00f01 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:5770:1875987821232512:0@lo:101: 00010000:00010000:1.0:1789081483.958344:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: 00000000af953db8/0xb7cb3d7479d5f43a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f441 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081483.958358:0:5770:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: 00000000af953db8/0xb7cb3d7479d5f43a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f441 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081483.959703:0:5770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c06d72a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:5770:1875987821232640:0@lo:501: 00000100:00100000:1.0:1789081483.959862:0:5770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081483.960166:0:5770:0:(client.c:2702:ptlrpc_set_wait()) set 000000009df9e8f7 going to sleep for 11 seconds 00000100:00100000:2.0:1789081483.960200:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821232640 00000100:00100000:2.0:1789081483.960220:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821232640 00000100:00100000:2.0:1789081483.960660:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789081483.960672:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ac25ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+6:5770:x1875987821232640:12345-0@lo:501: 00000100:00100000:2.0:1789081483.961825:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ac25ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+6:5770:x1875987821232640:12345-0@lo:501: Request processed in 1151us (1958us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789081483.961851:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789081483.962090:0:5770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c06d72a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:5770:1875987821232640:0@lo:501: 10000000:01000000:1.0:1789081483.962140:0:5770:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789081483.962211:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: 00000000af953db8/0xb7cb3d7479d5f43a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f441 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081483.962223:0:5770:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: 00000000af953db8/0xb7cb3d7479d5f43a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f441 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789081483.962233:0:5770:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e10ee974800 10000000:01000000:1.0:1789081483.962239:0:5770:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789081483.962245:0:5770:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e10ee974800 10000000:01000000:1.0:1789081483.962248:0:5770:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789081483.962251:0:5770:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9e10ee974800 from 1 10000000:01000000:1.0:1789081483.962270:0:5770:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789081483.962313:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: 000000008a092c07/0xb7cb3d7479d5f448 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081483.962322:0:5770:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: 000000008a092c07/0xb7cb3d7479d5f448 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081483.962332:0:5770:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: 000000008a092c07/0xb7cb3d7479d5f448 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081483.962354:0:5770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c06d72a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:5770:1875987821232768:0@lo:101: 00000100:00100000:1.0:1789081483.962398:0:5770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081483.962450:0:5770:0:(client.c:2702:ptlrpc_set_wait()) set 000000009df9e8f7 going to sleep for 11 seconds 00000100:00100000:0.0:1789081483.962697:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821232768 00000100:00100000:0.0:1789081483.962706:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821232768 00000100:00100000:0.0:1789081483.962759:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789081483.962766:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff2c64c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+6:5770:x1875987821232768:12345-0@lo:101: 00010000:00010000:0.0:1789081483.962781:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081483.962796:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000729d8ce/0xb7cb3d7479d5f44f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f448 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081483.962832:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000729d8ce/0xb7cb3d7479d5f44f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f448 expref: 7 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081483.962842:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000729d8ce/0xb7cb3d7479d5f44f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f448 expref: 7 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081483.962851:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000729d8ce, rc 0) 00000100:00100000:0.0:1789081483.963066:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff2c64c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+7:5770:x1875987821232768:12345-0@lo:101: Request processed in 300us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081483.963074:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789081483.963184:0:5770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c06d72a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:5770:1875987821232768:0@lo:101: 00010000:00010000:1.0:1789081483.963198:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: 000000008a092c07/0xb7cb3d7479d5f448 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f44f expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081483.963206:0:5770:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: 000000008a092c07/0xb7cb3d7479d5f448 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f44f expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789081483.963223:0:5770:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789081483.963421:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: 000000008a092c07/0xb7cb3d7479d5f448 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f44f expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081483.963431:0:5770:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: 000000008a092c07/0xb7cb3d7479d5f448 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f44f expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789081483.963438:0:5770:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789081483.963443:0:5770:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789081483.963449:0:5770:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e10ee974800 10000000:01000000:1.0:1789081483.963473:0:5770:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789081483.963477:0:5770:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789081483.963480:0:5770:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789081483.963502:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: 0000000016ccea44/0xb7cb3d7479d5f456 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081483.963508:0:5770:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: 0000000016ccea44/0xb7cb3d7479d5f456 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081483.963514:0:5770:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: 0000000016ccea44/0xb7cb3d7479d5f456 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081483.963551:0:5770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c06d72a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:5770:1875987821232896:0@lo:101: 00000100:00100000:1.0:1789081483.963596:0:5770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081483.963629:0:5770:0:(client.c:2702:ptlrpc_set_wait()) set 000000009df9e8f7 going to sleep for 11 seconds 00000100:00100000:0.0:1789081483.963757:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821232896 00000100:00100000:0.0:1789081483.963763:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821232896 00000100:00100000:0.0:1789081483.963810:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789081483.963818:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006acfea25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+7:5770:x1875987821232896:12345-0@lo:101: 00010000:00010000:0.0:1789081483.963829:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081483.963841:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f073dedc/0xb7cb3d7479d5f45d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f456 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081483.963880:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f073dedc/0xb7cb3d7479d5f45d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f456 expref: 8 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081483.963889:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f073dedc/0xb7cb3d7479d5f45d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f456 expref: 8 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081483.963895:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f073dedc, rc 0) 00000100:00100000:0.0:1789081483.963942:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006acfea25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+8:5770:x1875987821232896:12345-0@lo:101: Request processed in 125us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081483.963949:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789081483.964280:0:5770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c06d72a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:5770:1875987821232896:0@lo:101: 00010000:00010000:3.0:1789081483.964316:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: 0000000016ccea44/0xb7cb3d7479d5f456 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f45d expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081483.964330:0:5770:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: 0000000016ccea44/0xb7cb3d7479d5f456 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f45d expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081483.965234:0:5770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000084f9eaf4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:5770:1875987821233024:0@lo:501: 00000100:00100000:3.0:1789081483.965338:0:5770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081483.965423:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821233024 00000100:00100000:2.0:1789081483.965438:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821233024 00000100:00100000:2.0:1789081483.965517:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789081483.965545:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013361df4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+8:5770:x1875987821233024:12345-0@lo:501: 00000100:00100000:2.0:1789081483.966063:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013361df4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+9:5770:x1875987821233024:12345-0@lo:501: Request processed in 537us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081483.966072:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789081483.966238:0:5770:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d0c4e810 going to sleep for 11 seconds 00000100:00100000:3.0:1789081483.966274:0:5770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000084f9eaf4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:5770:1875987821233024:0@lo:501: 00000100:00100000:3.0:1789081483.966331:0:5770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000084f9eaf4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:5770:1875987821233152:0@lo:503: 00000100:00100000:3.0:1789081483.966388:0:5770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081483.966505:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821233152 00000100:00100000:1.0:1789081483.966514:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821233152 00000100:00100000:1.0:1789081483.966601:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789081483.966609:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000085d95de4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+9:5770:x1875987821233152:12345-0@lo:503: 00000100:00100000:1.0:1789081483.966842:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000085d95de4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+9:5770:x1875987821233152:12345-0@lo:503: Request processed in 233us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081483.966851:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789081483.970826:0:5770:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d0c4e810 going to sleep for 11 seconds 00000100:00100000:3.0:1789081483.970892:0:5770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000084f9eaf4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:5770:1875987821233152:0@lo:503: 00000100:00100000:3.0:1789081483.976838:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000084f9eaf4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:5812:1875987821233280:0@lo:502: 00000100:00100000:3.0:1789081483.976968:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081483.977045:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d8fd847b going to sleep for 11 seconds 00000100:00100000:2.0:1789081483.978172:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821233280 00000100:00100000:2.0:1789081483.978189:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821233280 00000100:00100000:2.0:1789081483.978280:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789081483.978292:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e701c334 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+9:5812:x1875987821233280:12345-0@lo:502: 00000100:00100000:2.0:1789081483.979027:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e701c334 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+9:5812:x1875987821233280:12345-0@lo:502: Request processed in 736us (2057us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081483.979038:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789081483.979179:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000084f9eaf4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:5812:1875987821233280:0@lo:502: 00000020:01000000:3.0:1789081483.979237:0:5812:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789081483.979251:0:5812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789081483.979254:0:5812:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789081483.979259:0:5812:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789081483.979263:0:5812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789081483.979281:0:5812:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000006edb0314) 00000020:00000080:3.0:1789081483.979304:0:5812:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789081483.979311:0:5812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789081483.979575:0:5812:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789081483.980010:0:5812:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb7cb3d7479d5f46b 00000020:00000080:3.0:1789081483.980311:0:5812:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789081483.980316:0:5812:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789081483.980320:0:5812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789081483.980321:0:5812:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789081483.980324:0:5812:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789081483.980329:0:5812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789081483.980330:0:5812:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789081483.980333:0:5812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789081483.980355:0:5812:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000099cbbcd1) 00000020:00000080:3.0:1789081483.980365:0:5812:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789081483.980370:0:5812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789081483.980372:0:5812:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789081483.980375:0:5812:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789081483.980381:0:5812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789081483.981209:0:5812:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000070b59caa from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789081483.981228:0:5812:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000002c17cadb) 00000020:00000080:3.0:1789081483.981240:0:5812:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789081483.981302:0:5812:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789081483.981309:0:5812:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb7cb3d7479d5f480 00000020:00000080:3.0:1789081483.982999:0:5812:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789081483.983016:0:5812:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789081483.983029:0:5812:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xb7cb3d7479d5f487 00080000:01000000:3.0:1789081483.983038:0:5812:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789081483.983043:0:5812:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb7cb3d7479d5f48e 00080000:10000000:2.0:1789081483.986470:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1789081483.988452:0:5812:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1789081483.996859:0:5812:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1789081484.060827:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081484.198692:0:5812:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1789081484.199855:0:5812:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1789081484.205081:0:5812:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1789081484.210315:0:5812:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789081484.306300:0:5812:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000a393952d) 00000020:00000080:0.0:1789081484.306331:0:5812:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1789081484.306427:0:5812:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789081484.306436:0:5812:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb7cb3d7479d5f49c 00000020:00000080:0.0:1789081484.317381:0:5812:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1789081484.339786:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789081484.440637:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789081484.548071:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789081484.672894:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789081484.745361:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789081484.847021:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1789081485.012067:0:5812:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xb7cb3d7479d5f4a3 00000020:00000080:1.0:1789081485.012570:0:5812:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789081485.012583:0:5812:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789081485.012591:0:5812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789081485.012593:0:5812:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789081485.012596:0:5812:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789081485.012603:0:5812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789081485.012604:0:5812:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789081485.012609:0:5812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789081485.012646:0:5812:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789081485.012658:0:5812:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789081485.012661:0:5812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789081485.012662:0:5812:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1789081485.012666:0:5812:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789081485.012668:0:5812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789081485.012669:0:5812:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789081485.012672:0:5812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789081485.012673:0:5812:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789081485.012720:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a6f52611 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:5812:1875987821233408:0@lo:502: 00000100:00100000:1.0:1789081485.012822:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081485.012885:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ea4c908a going to sleep for 11 seconds 00000100:00100000:0.0:1789081485.013574:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821233408 00000100:00100000:0.0:1789081485.013582:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821233408 00000100:00100000:0.0:1789081485.013635:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789081485.013644:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084e45ac4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+9:5812:x1875987821233408:12345-0@lo:502: 00000100:00100000:0.0:1789081485.014054:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084e45ac4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+9:5812:x1875987821233408:12345-0@lo:502: Request processed in 411us (1233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081485.014063:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789081485.014853:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a6f52611 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:5812:1875987821233408:0@lo:502: 00000020:01000000:2.0:1789081485.014915:0:5812:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789081485.014927:0:5812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789081485.014929:0:5812:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789081485.014934:0:5812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1789081485.015513:0:5770:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1789081485.015589:0:5770:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789081485.015604:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: 0000000016ccea44/0xb7cb3d7479d5f456 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f45d expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081485.015629:0:5770:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: 0000000016ccea44/0xb7cb3d7479d5f456 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f45d expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789081485.015638:0:5770:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e10ee974800 from 1 10000000:01000000:0.0:1789081485.015641:0:5770:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789081485.015689:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: 00000000f076caf3/0xb7cb3d7479d5f4aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081485.015696:0:5770:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: 00000000f076caf3/0xb7cb3d7479d5f4aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081485.015705:0:5770:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: 00000000f076caf3/0xb7cb3d7479d5f4aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081485.015727:0:5770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001cd971bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:5770:1875987821233536:0@lo:101: 00000100:00100000:0.0:1789081485.015808:0:5770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081485.015853:0:5770:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d8237053 going to sleep for 11 seconds 00000100:00100000:1.0:1789081485.016070:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821233536 00000100:00100000:1.0:1789081485.016078:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821233536 00000100:00100000:1.0:1789081485.016129:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789081485.016138:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000015f8b5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+9:5770:x1875987821233536:12345-0@lo:101: 00010000:00010000:1.0:1789081485.016155:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081485.016173:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c36439be/0xb7cb3d7479d5f4b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f4aa expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081485.016201:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c36439be/0xb7cb3d7479d5f4b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f4aa expref: 10 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081485.016223:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c36439be/0xb7cb3d7479d5f4b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f4aa expref: 10 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081485.016232:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c36439be, rc 0) 00000100:00100000:1.0:1789081485.016283:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000015f8b5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+10:5770:x1875987821233536:12345-0@lo:101: Request processed in 146us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081485.016290:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789081485.016716:0:5770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001cd971bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:5770:1875987821233536:0@lo:101: 00010000:00010000:0.0:1789081485.016735:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: 00000000f076caf3/0xb7cb3d7479d5f4aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f4b1 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081485.016745:0:5770:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: 00000000f076caf3/0xb7cb3d7479d5f4aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f4b1 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081485.017509:0:5770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001cd971bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:5770:1875987821233664:0@lo:256: 00000100:00100000:0.0:1789081485.017629:0:5770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081485.017670:0:5770:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d8237053 going to sleep for 11 seconds 00000100:00100000:2.0:1789081485.017811:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821233664 00000100:00100000:2.0:1789081485.017819:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821233664 00000100:00100000:2.0:1789081485.017857:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789081485.017871:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001082f62c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+10:5770:x1875987821233664:12345-0@lo:256: 20000000:01000000:2.0:1789081485.017901:0:5784:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789081485.017908:0:5784:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789081485.017986:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001082f62c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+10:5770:x1875987821233664:12345-0@lo:256: Request processed in 116us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081485.017995:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789081485.018383:0:5770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001cd971bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:5770:1875987821233664:0@lo:256: 10000000:01000000:0.0:1789081485.019616:0:5770:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789081485.019640:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: 00000000f076caf3/0xb7cb3d7479d5f4aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f4b1 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081485.019653:0:5770:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: 00000000f076caf3/0xb7cb3d7479d5f4aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f4b1 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789081485.023382:0:5770:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e10ee974800 from 1 10000000:01000000:1.0:1789081485.023395:0:5770:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789081485.023462:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: 00000000cda72b71/0xb7cb3d7479d5f4b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081485.023476:0:5770:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: 00000000cda72b71/0xb7cb3d7479d5f4b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081485.023486:0:5770:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: 00000000cda72b71/0xb7cb3d7479d5f4b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081485.023514:0:5770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001d3f681f pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:5770:1875987821233792:0@lo:101: 00000100:00100000:1.0:1789081485.023626:0:5770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081485.023692:0:5770:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a108e5ae going to sleep for 11 seconds 00000100:00100000:2.0:1789081485.023807:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821233792 00000100:00100000:2.0:1789081485.023817:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821233792 00000100:00100000:2.0:1789081485.023878:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789081485.023885:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cbea741d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+10:5770:x1875987821233792:12345-0@lo:101: 00010000:00010000:2.0:1789081485.023913:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081485.023930:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001ddc633b/0xb7cb3d7479d5f4bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f4b8 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081485.023953:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001ddc633b/0xb7cb3d7479d5f4bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f4b8 expref: 11 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081485.023962:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001ddc633b/0xb7cb3d7479d5f4bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f4b8 expref: 11 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081485.023970:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001ddc633b, rc 0) 00000100:00100000:2.0:1789081485.024011:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cbea741d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+11:5770:x1875987821233792:12345-0@lo:101: Request processed in 127us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081485.024018:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789081485.024402:0:5770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001d3f681f pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:5770:1875987821233792:0@lo:101: 00010000:00010000:0.0:1789081485.024422:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: 00000000cda72b71/0xb7cb3d7479d5f4b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f4bf expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081485.024432:0:5770:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: 00000000cda72b71/0xb7cb3d7479d5f4b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f4bf expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081485.024510:0:5770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001cd971bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:5770:1875987821233920:0@lo:501: 00000100:00100000:0.0:1789081485.024575:0:5770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081485.024612:0:5770:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d8237053 going to sleep for 11 seconds 00000100:00100000:1.0:1789081485.024700:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821233920 00000100:00100000:1.0:1789081485.024705:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821233920 00000100:00100000:1.0:1789081485.024737:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789081485.024744:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066337283 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+11:5770:x1875987821233920:12345-0@lo:501: 00000100:00100000:1.0:1789081485.026645:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066337283 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+11:5770:x1875987821233920:12345-0@lo:501: Request processed in 1892us (2060us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081485.026661:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789081485.028468:0:5770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001cd971bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:5770:1875987821233920:0@lo:501: 00000100:00100000:2.0:1789081485.029684:0:5770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007229b663 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:5770:1875987821234048:0@lo:503: 00000100:00100000:2.0:1789081485.029993:0:5770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081485.030108:0:5770:0:(client.c:2702:ptlrpc_set_wait()) set 000000004481d172 going to sleep for 11 seconds 00000100:00100000:1.0:1789081485.035313:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821234048 00000100:00100000:1.0:1789081485.035333:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821234048 00000100:00100000:1.0:1789081485.035704:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789081485.035716:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000813afb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+11:5770:x1875987821234048:12345-0@lo:503: 00000040:00080000:1.0:1789081485.035821:0:5782:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789081485.035947:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000813afb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+11:5770:x1875987821234048:12345-0@lo:503: Request processed in 235us (5956us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081485.035956:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789081485.036071:0:5770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007229b663 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:5770:1875987821234048:0@lo:503: 00000040:00080000:3.0:1789081485.040704:0:5816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1789081485.041035:0:5770:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1789081485.041063:0:5770:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789081485.041087:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: 00000000cda72b71/0xb7cb3d7479d5f4b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f4bf expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081485.041100:0:5770:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: 00000000cda72b71/0xb7cb3d7479d5f4b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f4bf expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789081485.041153:0:5770:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789081485.041173:0:5770:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e10ee974800 10000000:01000000:0.0:1789081485.041177:0:5770:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e10ee974800 10000000:01000000:0.0:1789081485.041182:0:5770:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789081485.041189:0:5770:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e10ee974800 from 1 10000000:01000000:0.0:1789081485.041192:0:5770:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789081485.041231:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: 00000000c81dc982/0xb7cb3d7479d5f4c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081485.041253:0:5770:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: 00000000c81dc982/0xb7cb3d7479d5f4c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081485.041264:0:5770:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: 00000000c81dc982/0xb7cb3d7479d5f4c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081485.041292:0:5770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a7ee54de pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:5770:1875987821234176:0@lo:101: 00000100:00100000:0.0:1789081485.041386:0:5770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081485.041469:0:5770:0:(client.c:2702:ptlrpc_set_wait()) set 000000002e369a66 going to sleep for 11 seconds 00000100:00100000:2.0:1789081485.041670:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821234176 00000100:00100000:2.0:1789081485.041678:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821234176 00000100:00100000:2.0:1789081485.041719:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789081485.041727:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6a25a13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+11:5770:x1875987821234176:12345-0@lo:101: 00010000:00010000:2.0:1789081485.041742:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081485.041755:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a2523ee2/0xb7cb3d7479d5f4cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f4c6 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081485.041779:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a2523ee2/0xb7cb3d7479d5f4cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f4c6 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081485.041791:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a2523ee2/0xb7cb3d7479d5f4cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f4c6 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081485.041799:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a2523ee2, rc 0) 00000100:00100000:2.0:1789081485.041841:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6a25a13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:5770:x1875987821234176:12345-0@lo:101: Request processed in 115us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081485.041847:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789081485.042552:0:5770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a7ee54de pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:5770:1875987821234176:0@lo:101: 00010000:00010000:0.0:1789081485.042569:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: 00000000c81dc982/0xb7cb3d7479d5f4c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f4cd expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081485.042579:0:5770:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: 00000000c81dc982/0xb7cb3d7479d5f4c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f4cd expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081485.042641:0:5770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a7ee54de pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:5770:1875987821234304:0@lo:501: 00000100:00100000:0.0:1789081485.042679:0:5770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081485.042710:0:5770:0:(client.c:2702:ptlrpc_set_wait()) set 000000002e369a66 going to sleep for 11 seconds 00000100:00100000:0.0:1789081485.044434:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821234304 00000100:00100000:0.0:1789081485.044462:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821234304 00000100:00100000:0.0:1789081485.044519:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789081485.044561:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd6423c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:5770:x1875987821234304:12345-0@lo:501: 00000100:00100000:0.0:1789081485.045425:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd6423c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:5770:x1875987821234304:12345-0@lo:501: Request processed in 863us (2743us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081485.045436:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789081485.045664:0:5770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a7ee54de pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:5770:1875987821234304:0@lo:501: 00000100:00100000:2.0:1789081485.045719:0:5770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b84de869 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:5770:1875987821234432:0@lo:503: 00000100:00100000:2.0:1789081485.045776:0:5770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081485.045821:0:5770:0:(client.c:2702:ptlrpc_set_wait()) set 00000000da811413 going to sleep for 11 seconds 00000100:00100000:3.0:1789081485.045869:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821234432 00000100:00100000:3.0:1789081485.045876:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821234432 00000100:00100000:3.0:1789081485.045924:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789081485.045931:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2a95507 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:5770:x1875987821234432:12345-0@lo:503: 00000100:00100000:3.0:1789081485.046290:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2a95507 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:5770:x1875987821234432:12345-0@lo:503: Request processed in 359us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081485.046297:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789081485.046515:0:5770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b84de869 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:5770:1875987821234432:0@lo:503: 00000100:00100000:1.0:1789081485.047140:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001590db03 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:5817:1875987821234560:0@lo:502: 00000100:00100000:1.0:1789081485.047199:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081485.047314:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set 000000005d0c3f13 going to sleep for 11 seconds 00000100:00100000:3.0:1789081485.047363:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821234560 00000100:00100000:3.0:1789081485.047370:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821234560 00000100:00100000:3.0:1789081485.047410:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789081485.047417:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f621f05d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:5817:x1875987821234560:12345-0@lo:502: 00000100:00100000:3.0:1789081485.047773:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f621f05d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:5817:x1875987821234560:12345-0@lo:502: Request processed in 357us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081485.047782:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789081485.047871:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001590db03 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:5817:1875987821234560:0@lo:502: 00000020:01000004:1.0:1789081485.047947:0:5817:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1789081485.047976:0:5817:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000017ae830b) 00000020:00000080:1.0:1789081485.048001:0:5817:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1789081485.048431:0:5817:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000070b59caa from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789081485.048436:0:5817:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000070b59caa from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789081485.048452:0:5817:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000070b59caa 4 00010000:00080000:1.0:1789081485.048492:0:5817:0:(ldlm_lib.c:102:import_set_conn()) imp 000000005637cf47@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.117@tcp at head 00010000:00010000:1.0:1789081485.054005:0:5817:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1789081485.054161:0:5817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789081485.054200:0:5817:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789081485.054215:0:5817:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xb7cb3d7479d5f4db 00000100:00080000:1.0:1789081485.054227:0:5817:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789081485.054232:0:5817:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000005637cf47 using connection 192.168.201.117@tcp/0@lo 00000100:00100000:1.0:1789081485.054273:0:5817:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001590db03 x1875987821234688/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789081485.054304:0:5817:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789081485.064585:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001590db03 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875987821234688:0@lo:38: 00000100:00100000:2.0:1789081485.064696:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081485.068885:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821234688 00000100:00100000:0.0:1789081485.068911:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821234688 00000100:00100000:0.0:1789081485.069109:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789081485.069118:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b84de869 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1875987821234688:12345-0@lo:38: 00000100:00100000:0.0:1789081485.072901:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b84de869 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1875987821234688:12345-0@lo:38: Request processed in 3756us (8178us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789081485.072929:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789081485.078519:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000084f9eaf4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:5817:1875987821234816:0@lo:502: 00000100:00100000:3.0:1789081485.078662:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081485.078730:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f037e39c going to sleep for 11 seconds 00000100:00100000:3.0:1789081485.078759:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821234816 00000100:00100000:3.0:1789081485.078769:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821234816 00000100:00100000:3.0:1789081485.078826:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789081485.078856:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5caec5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:5817:x1875987821234816:12345-0@lo:502: 00000100:00100000:3.0:1789081485.079646:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5caec5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:5817:x1875987821234816:12345-0@lo:502: Request processed in 785us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081485.079658:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789081485.079748:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000084f9eaf4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:5817:1875987821234816:0@lo:502: 00000040:00080000:3.0:1789081485.079790:0:5817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1789081485.083217:0:5770:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1789081485.083325:0:5770:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789081485.083366:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: 00000000c81dc982/0xb7cb3d7479d5f4c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f4cd expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081485.083380:0:5770:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: 00000000c81dc982/0xb7cb3d7479d5f4c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f4cd expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789081485.083436:0:5770:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789081485.083450:0:5770:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789081485.083451:0:5770:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789081485.083453:0:5770:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789081485.083454:0:5770:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789081485.083455:0:5770:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789081485.083456:0:5770:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789081485.083458:0:5770:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789081485.083459:0:5770:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789081485.083460:0:5770:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789081485.083461:0:5770:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789081485.083462:0:5770:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789081485.083466:0:5770:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1789081485.083469:0:5770:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789081485.083470:0:5770:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789081485.083470:0:5770:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789081485.083471:0:5770:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789081485.083472:0:5770:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789081485.083473:0:5770:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789081485.083474:0:5770:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789081485.083475:0:5770:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789081485.083476:0:5770:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789081485.083477:0:5770:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789081485.083478:0:5770:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789081485.083478:0:5770:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789081485.083508:0:5770:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789081485.083549:0:5770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fae8e679 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:5770:1875987821234944:0@lo:253: 00000100:00100000:2.0:1789081485.083648:0:5770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081485.083704:0:5770:0:(client.c:2702:ptlrpc_set_wait()) set 00000000da811413 going to sleep for 11 seconds 00010000:00010000:1.0:1789081485.090230:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081485.091089:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789081485.091104:0:3302:0:(import.c:65:import_set_state_nolock()) 000000005637cf47 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789081485.091115:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789081485.091120:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001590db03 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875987821234688:0@lo:38: 00000100:00100000:3.0:1789081485.091171:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821234944 00000100:00100000:3.0:1789081485.091182:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821234944 00000100:00100000:3.0:1789081485.091650:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789081485.091661:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006df8e485 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:5770:x1875987821234944:12345-0@lo:253: 20000000:01000000:3.0:1789081485.091705:0:5783:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789081485.091723:0:5783:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789081485.168116:0:5783:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789081485.168135:0:5783:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789081485.168288:0:5805:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789081485.168294:0:5805:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789081485.168327:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003dd83dbc/0xb7cb3d7479d5f4e2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081485.168354:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c36439be/0xb7cb3d7479d5f4b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f4aa expref: 12 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081485.168363:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000003dd83dbc/0xb7cb3d7479d5f4e2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081485.168414:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c36439be/0xb7cb3d7479d5f4b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb7cb3d7479d5f4aa expref: 12 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081485.168458:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c36439be/0xb7cb3d7479d5f4b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f4aa expref: 12 pid: 5782 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081485.168477:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000084f9eaf4 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5805:1875987821235072:0@lo:104: 00000100:00100000:3.0:1789081485.168606:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081485.168668:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f037e39c going to sleep for 11 seconds 00000100:00100000:0.0:1789081485.169175:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821235072 00000100:00100000:0.0:1789081485.169187:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821235072 00000100:00100000:0.0:1789081485.169252:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789081485.169261:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be481def pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+3:5805:x1875987821235072:12345-0@lo:104: 00010000:00010000:0.0:1789081485.169277:0:5772:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.117@tcp lock: 00000000f076caf3/0xb7cb3d7479d5f4aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f4b1 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081485.169348:0:5772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789081485.169354:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be481def pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+3:5805:x1875987821235072:12345-0@lo:104: Request processed in 94us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081485.169361:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1789081485.169387:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789081485.169392:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: 00000000f076caf3/0xb7cb3d7479d5f4aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f4b1 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081485.169399:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f076caf3 already unused, calling callback (000000007a2b1649) 10000000:00010000:0.0:1789081485.169413:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: 00000000f076caf3/0xb7cb3d7479d5f4aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb7cb3d7479d5f4b1 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081485.169420:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: 00000000f076caf3/0xb7cb3d7479d5f4aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb7cb3d7479d5f4b1 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789081485.169427:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: 00000000f076caf3/0xb7cb3d7479d5f4aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb7cb3d7479d5f4b1 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789081485.169433:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789081485.169475:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: 00000000f076caf3/0xb7cb3d7479d5f4aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f4b1 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081485.169483:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789081485.169510:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: 00000000f076caf3/0xb7cb3d7479d5f4aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f4b1 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081485.169517:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: 00000000f076caf3/0xb7cb3d7479d5f4aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f4b1 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081485.169555:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081485.169557:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081485.169559:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789081485.169618:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789081485.169621:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000084f9eaf4 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5805:1875987821235072:0@lo:104: 00000100:00100000:0.0:1789081485.169628:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e0007eef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee551687-7675-4fc6-9be1-2ccb62bdd809:3303:1875987821235200:0@lo:103: 00010000:00010000:3.0:1789081485.169642:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000003dd83dbc/0xb7cb3d7479d5f4e2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081485.169661:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081485.169880:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821235200 00000100:00100000:2.0:1789081485.169887:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821235200 00010000:00010000:2.0:1789081485.169919:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c36439be/0xb7cb3d7479d5f4b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f4aa expref: 13 pid: 5782 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081485.169947:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789081485.169953:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000feeb395a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:3303:x1875987821235200:12345-0@lo:103: 00010000:00010000:2.0:1789081485.169964:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789081485.169969:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c36439be/0xb7cb3d7479d5f4b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f4aa expref: 13 pid: 5782 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081485.169979:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c36439be/0xb7cb3d7479d5f4b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f4aa expref: 13 pid: 5782 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081485.169993:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c36439be/0xb7cb3d7479d5f4b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb7cb3d7479d5f4aa expref: 13 pid: 5782 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081485.170005:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000003dd83dbc/0xb7cb3d7479d5f4e2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081485.170012:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003dd83dbc/0xb7cb3d7479d5f4e2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789081485.170025:0:5774:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001732705s 00010000:00010000:2.0:1789081485.170029:0:5774:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003dd83dbc/0xb7cb3d7479d5f4e2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081485.170035:0:5774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003dd83dbc/0xb7cb3d7479d5f4e2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081485.170041:0:5774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003dd83dbc/0xb7cb3d7479d5f4e2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081485.170046:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003dd83dbc/0xb7cb3d7479d5f4e2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081485.170058:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003dd83dbc already unused, calling callback (000000004b47f47c) 00010000:00010000:2.0:1789081485.170061:0:5774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003dd83dbc/0xb7cb3d7479d5f4e2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081485.170067:0:5774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003dd83dbc/0xb7cb3d7479d5f4e2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081485.170086:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003dd83dbc/0xb7cb3d7479d5f4e2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081485.170096:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789081485.170128:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000feeb395a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:3303:x1875987821235200:12345-0@lo:103: Request processed in 175us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081485.170134:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789081485.171006:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e0007eef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee551687-7675-4fc6-9be1-2ccb62bdd809:3303:1875987821235200:0@lo:103: 00010000:00010000:0.0:1789081485.171040:0:5805:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000003dd83dbc/0xb7cb3d7479d5f4e2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081485.171049:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003dd83dbc/0xb7cb3d7479d5f4e2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081485.171066:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003dd83dbc/0xb7cb3d7479d5f4e2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081485.188210:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006df8e485 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+11:5770:x1875987821234944:12345-0@lo:253: Request processed in 96543us (104553us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081485.188229:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789081485.188431:0:5770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fae8e679 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:5770:1875987821234944:0@lo:253: 10000000:01000000:0.0:1789081485.188458:0:5770:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789081485.188462:0:5770:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789081485.188464:0:5770:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789081485.188465:0:5770:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789081485.188466:0:5770:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789081485.188468:0:5770:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789081485.188469:0:5770:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789081485.188470:0:5770:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789081485.188472:0:5770:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789081485.188473:0:5770:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789081485.188474:0:5770:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789081485.188476:0:5770:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789081485.188478:0:5770:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789081485.188495:0:5770:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789081485.195458:0:5770:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1789081485.195928:0:5770:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789081485.196997:0:5770:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1789081485.197210:0:5770:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789081485.197500:0:5770:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1789081485.197773:0:5770:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1789081485.198653:0:5770:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1789081485.198824:0:5770:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1789081485.199067:0:5770:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1789081485.199332:0:5770:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1789081485.199694:0:5770:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1789081485.200174:0:5770:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1789081485.311642:0:5770:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1789081485.392788:0:5770:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1789081485.396459:0:5822:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1789081485.396471:0:5822:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1789081485.396697:0:5823:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789081485.399923:0:5770:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789081485.400105:0:5770:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789081485.404704:0:5770:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789081485.405970:0:5770:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1789081485.406371:0:5770:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789081485.408625:0:5770:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789081485.412602:0:5770:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789081485.412674:0:5770:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1789081485.413694:0:5770:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1789081485.414376:0:5770:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1789081485.419344:0:5770:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1789081485.419580:0:5770:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1789081485.420339:0:5770:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1789081485.420577:0:5770:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1789081485.420842:0:5770:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1789081485.421003:0:5770:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1789081485.423416:0:5770:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1789081485.423683:0:5770:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1789081485.425075:0:5770:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1789081485.425288:0:5770:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1789081485.427299:0:5770:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1789081485.429586:0:5770:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1789081485.430241:0:5770:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1789081485.430393:0:5770:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1789081485.430604:0:5770:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1789081485.430987:0:5770:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1789081485.431332:0:5770:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1789081485.431482:0:5770:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1789081485.431666:0:5770:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1789081485.432397:0:5770:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1789081485.432612:0:5770:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1789081485.432754:0:5770:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1789081485.432939:0:5770:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1789081485.433092:0:5770:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1789081485.433239:0:5770:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1789081485.433399:0:5770:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1789081485.438548:0:5770:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1789081485.440492:0:5770:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1789081485.440857:0:5770:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1789081485.441004:0:5770:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1789081485.441204:0:5770:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1789081485.442005:0:5770:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1789081485.442224:0:5770:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1789081485.515764:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1789081485.667911:0:5770:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789081485.667983:0:5770:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffadf201d73988 00100000:10000000:0.0:1789081485.667996:0:5770:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789081485.670108:0:5770:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789081485.670129:0:5770:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.117@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789081485.670164:0:5770:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1789081485.670200:0:5770:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1789081485.742883:0:5823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789081485.742981:0:5823:0:(lod_dev.c:522:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789081485.742985:0:5823:0:(lod_dev.c:546:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1789081486.108794:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081487.151624:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081488.157406:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081489.180783:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081490.204996:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789081490.282222:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789081490.282236:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789081490.282240:0:36:0:(import.c:65:import_set_state_nolock()) 000000005637cf47 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789081490.282255:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000005637cf47 using connection 192.168.201.117@tcp/0@lo 00000100:00100000:2.0:1789081490.282278:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000090465cb2 x1875987821235456/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789081490.282480:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789081490.282495:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b45cadc8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821235328:0@lo:400: 00000100:00100000:0.0:1789081490.282616:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081490.282675:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000090465cb2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875987821235456:0@lo:38: 00000100:00100000:3.0:1789081490.282713:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081490.282762:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821235456 00000100:00100000:3.0:1789081490.282771:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821235456 00000100:00100000:3.0:1789081490.282805:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789081490.282812:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084f9eaf4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1875987821235456:12345-0@lo:38: 00010000:00080000:3.0:1789081490.282840:0:5791:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 157 last 0 00000020:00000080:3.0:1789081490.282886:0:5791:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xb7cb3d7479d5f4e9 00000004:00100000:3.0:1789081490.283088:0:5791:0:(mdt_handler.c:7406:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1789081490.283426:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821235328 00000100:00100000:2.0:1789081490.283435:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821235328 00000100:00100000:2.0:1789081490.283475:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789081490.283482:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000026be3db1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+11:3306:x1875987821235328:12345-0@lo:400: 00000100:00100000:2.0:1789081490.283575:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000026be3db1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+11:3306:x1875987821235328:12345-0@lo:400: Request processed in 93us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081490.283582:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789081490.283653:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b45cadc8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821235328:0@lo:400: 00000100:00080000:3.0:1789081490.284091:0:5791:0:(import.c:65:import_set_state_nolock()) 00000000e55a3160 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789081490.284401:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084f9eaf4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875987821235456:12345-0@lo:38: Request processed in 1587us (1687us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081490.284410:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789081490.284628:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000090465cb2 x1875987821235456/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789081500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789081490.284645:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789081490.284653:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789081490.284659:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789081490.284662:0:3302:0:(import.c:65:import_set_state_nolock()) 000000005637cf47 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789081490.284668:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000090465cb2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875987821235456:0@lo:38: 00010000:00010000:3.0:1789081491.228667:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789081491.699339:0:6067:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg117-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:0.0:1789081491.806610:0:5786:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789081491.806622:0:5786:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e10ee974800 from 3 10000000:01000000:0.0:1789081491.806629:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789081491.806691:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: 00000000d3817a9d/0xb7cb3d7479d5f4f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081491.806710:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: 00000000d3817a9d/0xb7cb3d7479d5f4f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081491.806723:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: 00000000d3817a9d/0xb7cb3d7479d5f4f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081491.806752:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e0007eef pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821235584:0@lo:101: 00000100:00100000:0.0:1789081491.806855:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081491.806932:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set 00000000547adc39 going to sleep for 11 seconds 00000100:00100000:3.0:1789081491.807104:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821235584 00000100:00100000:3.0:1789081491.807114:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821235584 00000100:00100000:3.0:1789081491.807181:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789081491.807189:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7d6e1ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+11:5786:x1875987821235584:12345-0@lo:101: 00010000:00010000:3.0:1789081491.807204:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081491.807219:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a4aedddc/0xb7cb3d7479d5f4f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f4f0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081491.807245:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a4aedddc/0xb7cb3d7479d5f4f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f4f0 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081491.807256:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a4aedddc/0xb7cb3d7479d5f4f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f4f0 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081491.807265:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a4aedddc, rc 0) 00000100:00100000:3.0:1789081491.807313:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7d6e1ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:5786:x1875987821235584:12345-0@lo:101: Request processed in 125us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081491.807357:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789081491.807698:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e0007eef pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821235584:0@lo:101: 00010000:00010000:1.0:1789081491.807716:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: 00000000d3817a9d/0xb7cb3d7479d5f4f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f4f7 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081491.807724:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: 00000000d3817a9d/0xb7cb3d7479d5f4f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f4f7 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081491.807786:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004871e228 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821235712:0@lo:256: 00000100:00100000:1.0:1789081491.807825:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081491.807846:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b30eb74e going to sleep for 11 seconds 00000100:00100000:0.0:1789081491.808041:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821235712 00000100:00100000:0.0:1789081491.808048:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821235712 00000100:00100000:0.0:1789081491.808089:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789081491.808096:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044b21a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:5786:x1875987821235712:12345-0@lo:256: 20000000:01000000:0.0:1789081491.808113:0:5784:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789081491.808140:0:5784:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789081491.808144:0:5784:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1789081491.808237:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044b21a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:5786:x1875987821235712:12345-0@lo:256: Request processed in 142us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081491.808245:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789081491.808280:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004871e228 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821235712:0@lo:256: 10000000:01000000:0.0:1789081491.808340:0:5786:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789081491.808348:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: 00000000d3817a9d/0xb7cb3d7479d5f4f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f4f7 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081491.808363:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: 00000000d3817a9d/0xb7cb3d7479d5f4f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f4f7 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081492.254962:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081493.276675:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081494.304950:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081495.328890:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081495.405133:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009adacde2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875987821235968:0@lo:400: 00000100:00100000:1.0:1789081495.405310:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789081495.405326:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d21ab8f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821235840:0@lo:400: 00000100:00100000:1.0:1789081495.405368:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081495.405445:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821235840 00000100:00100000:1.0:1789081495.405455:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821235840 00000100:00100000:1.0:1789081495.405512:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789081495.405549:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000533005b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:3305:x1875987821235840:12345-0@lo:400: 00000100:00100000:1.0:1789081495.405608:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000533005b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:3305:x1875987821235840:12345-0@lo:400: Request processed in 87us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081495.405627:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789081495.405683:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d21ab8f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821235840:0@lo:400: 00000100:00100000:3.0:1789081495.405751:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081495.406656:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821235968 00000100:00100000:1.0:1789081495.406666:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821235968 00000100:00100000:1.0:1789081495.406715:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789081495.406722:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000013a489 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875987821235968:12345-0@lo:400: 00000100:00100000:1.0:1789081495.406786:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000013a489 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875987821235968:12345-0@lo:400: Request processed in 65us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081495.406792:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789081495.406885:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009adacde2 x1875987821235968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789081511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789081495.406900:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009adacde2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875987821235968:0@lo:400: 00010000:00010000:0.0:1789081496.348816:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081497.374057:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789081497.398682:0:6269:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff9d7ded90 20000000:00000080:3.0:1789081497.398706:0:6269:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e10e4405c00 uarg=0000000000000000 20000000:01000000:3.0:1789081497.398749:0:6269:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789081497.398764:0:6269:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789081497.398770:0:6269:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789081497.398969:0:6269:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1789081497.398982:0:6269:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1789081497.411873:0:6269:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789081497.412192:0:6269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789081497.412271:0:6269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1789081497.412325:0:6269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1789081497.412356:0:6269:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789081497.412379:0:6269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f076caf3/0xb7cb3d7479d5f4fe lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081497.412403:0:6269:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001ddc633b/0xb7cb3d7479d5f4bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f4b8 expref: 11 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081497.412412:0:6269:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000f076caf3/0xb7cb3d7479d5f4fe lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081497.412463:0:6269:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001ddc633b/0xb7cb3d7479d5f4bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb7cb3d7479d5f4b8 expref: 11 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081497.412492:0:6269:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001ddc633b/0xb7cb3d7479d5f4bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f4b8 expref: 11 pid: 5784 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081497.412510:0:6269:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f3326c55 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6269:1875987821236096:0@lo:104: 00000100:00100000:0.0:1789081497.412794:0:6269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081497.412869:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821236096 00000100:00100000:0.0:1789081497.412871:0:6269:0:(client.c:2702:ptlrpc_set_wait()) set 000000007f24ef2e going to sleep for 11 seconds 00000100:00100000:1.0:1789081497.412880:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821236096 00000100:00100000:1.0:1789081497.412948:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789081497.412958:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001bf76e9e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+3:6269:x1875987821236096:12345-0@lo:104: 00010000:00010000:1.0:1789081497.412974:0:5772:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.117@tcp lock: 00000000cda72b71/0xb7cb3d7479d5f4b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f4bf expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081497.413054:0:5772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789081497.413062:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001bf76e9e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+3:6269:x1875987821236096:12345-0@lo:104: Request processed in 104us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081497.413070:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789081497.413086:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789081497.413093:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: 00000000cda72b71/0xb7cb3d7479d5f4b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f4bf expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081497.413105:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cda72b71 already unused, calling callback (000000007a2b1649) 00000100:00100000:0.0:1789081497.413105:0:6269:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f3326c55 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6269:1875987821236096:0@lo:104: 10000000:00010000:3.0:1789081497.413111:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: 00000000cda72b71/0xb7cb3d7479d5f4b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb7cb3d7479d5f4bf expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081497.413121:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: 00000000cda72b71/0xb7cb3d7479d5f4b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb7cb3d7479d5f4bf expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789081497.413129:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: 00000000cda72b71/0xb7cb3d7479d5f4b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb7cb3d7479d5f4bf expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081497.413134:0:6269:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000f076caf3/0xb7cb3d7479d5f4fe lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789081497.413135:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789081497.413184:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: 00000000cda72b71/0xb7cb3d7479d5f4b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f4bf expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081497.413190:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789081497.413246:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009adacde2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821236224:0@lo:103: 00000100:00100000:0.0:1789081497.413270:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1789081497.413329:0:5786:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789081497.413332:0:5786:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e10ee974800 from 1 10000000:01000000:1.0:1789081497.413334:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00000100:00100000:2.0:1789081497.413338:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821236224 00000100:00100000:2.0:1789081497.413344:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821236224 00010000:00010000:1.0:1789081497.413352:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: 0000000078ab9c5a/0xb7cb3d7479d5f505 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081497.413361:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: 0000000078ab9c5a/0xb7cb3d7479d5f505 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081497.413372:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001ddc633b/0xb7cb3d7479d5f4bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f4b8 expref: 12 pid: 5784 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081497.413395:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: 0000000078ab9c5a/0xb7cb3d7479d5f505 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081497.413412:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000035c7754d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821236352:0@lo:101: 00000100:00100000:2.0:1789081497.413418:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789081497.413427:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3326c55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:3304:x1875987821236224:12345-0@lo:103: 00010000:00010000:2.0:1789081497.413443:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789081497.413449:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001ddc633b/0xb7cb3d7479d5f4bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f4b8 expref: 12 pid: 5784 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081497.413455:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081497.413474:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set 00000000827248e7 going to sleep for 11 seconds 00010000:00010000:2.0:1789081497.413477:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001ddc633b/0xb7cb3d7479d5f4bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f4b8 expref: 12 pid: 5784 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081497.413498:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821236352 00000100:00100000:1.0:1789081497.413503:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821236352 00010000:00010000:2.0:1789081497.413510:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001ddc633b/0xb7cb3d7479d5f4bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb7cb3d7479d5f4b8 expref: 13 pid: 5784 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081497.413558:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000f076caf3/0xb7cb3d7479d5f4fe lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081497.413563:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1789081497.413573:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f076caf3/0xb7cb3d7479d5f4fe lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081497.413574:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023069ef6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:5786:x1875987821236352:12345-0@lo:101: 00010000:00010000:1.0:1789081497.413594:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081497.413595:0:5774:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f076caf3/0xb7cb3d7479d5f4fe lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081497.413604:0:5774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f076caf3/0xb7cb3d7479d5f4fe lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081497.413607:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d4df4081/0xb7cb3d7479d5f50c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f505 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081497.413618:0:5774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f076caf3/0xb7cb3d7479d5f4fe lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081497.413627:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f076caf3/0xb7cb3d7479d5f4fe lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081497.413630:0:5782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f076caf3/0xb7cb3d7479d5f4fe lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081497.413694:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: 00000000cda72b71/0xb7cb3d7479d5f4b8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f4bf expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081497.413702:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: 00000000cda72b71/0xb7cb3d7479d5f4b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f4bf expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081497.413714:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081497.413715:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081497.413725:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081497.413763:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000d4df4081/0xb7cb3d7479d5f50c lrc: 4/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f505 expref: 13 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081497.413774:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f076caf3 already unused, calling callback (000000004b47f47c) 00010000:00010000:1.0:1789081497.413779:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f076caf3/0xb7cb3d7479d5f4fe lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081497.413781:0:5774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f076caf3/0xb7cb3d7479d5f4fe lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081497.413797:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f076caf3/0xb7cb3d7479d5f4fe lrc: 7/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081497.413799:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f076caf3/0xb7cb3d7479d5f4fe lrc: 7/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081497.413855:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789081497.415061:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3326c55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:3304:x1875987821236224:12345-0@lo:103: Request processed in 1630us (1782us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081497.415080:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009adacde2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821236224:0@lo:103: 00000100:00100000:2.0:1789081497.415097:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789081497.415376:0:6269:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000f076caf3/0xb7cb3d7479d5f4fe lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081497.415387:0:6269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f076caf3/0xb7cb3d7479d5f4fe lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081497.417830:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000d4df4081/0xb7cb3d7479d5f50c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50080000000000 nid: 0@lo remote: 0xb7cb3d7479d5f505 expref: 12 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081497.417865:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d4df4081/0xb7cb3d7479d5f50c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50080000000000 nid: 0@lo remote: 0xb7cb3d7479d5f505 expref: 12 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081497.417916:0:5782:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: MGS lock: 00000000d4df4081/0xb7cb3d7479d5f50c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f505 expref: 12 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081497.417935:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004e10a732 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5782:1875987821236480:0@lo:105: 00000100:00100000:1.0:1789081497.418206:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081497.418292:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set 000000005051a2ae going to sleep for 11 seconds 00000100:00100000:2.0:1789081497.418889:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821236480 00000100:00100000:2.0:1789081497.418901:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821236480 00000100:00100000:2.0:1789081497.418974:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789081497.418985:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb50afad pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+3:5782:x1875987821236480:12345-0@lo:105: 00010000:00010000:2.0:1789081497.419000:0:5772:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: MGC192.168.201.117@tcp lock: 0000000078ab9c5a/0xb7cb3d7479d5f505 lrc: 4/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f50c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081497.419009:0:5772:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: MGC192.168.201.117@tcp lock: 0000000078ab9c5a/0xb7cb3d7479d5f505 lrc: 4/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f50c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081497.419016:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGC192.168.201.117@tcp lock: 0000000078ab9c5a/0xb7cb3d7479d5f505 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0xb7cb3d7479d5f50c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081497.419020:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: 0000000078ab9c5a/0xb7cb3d7479d5f505 lrc: 5/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0xb7cb3d7479d5f50c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081497.419025:0:5772:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: MGC192.168.201.117@tcp lock: 0000000078ab9c5a/0xb7cb3d7479d5f505 lrc: 5/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1080000000000 nid: local remote: 0xb7cb3d7479d5f50c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081497.419040:0:5772:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock 0000000078ab9c5a) 00000100:00100000:2.0:1789081497.419098:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb50afad pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+3:5782:x1875987821236480:12345-0@lo:105: Request processed in 114us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081497.419106:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789081497.419200:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004e10a732 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5782:1875987821236480:0@lo:105: 00010000:00010000:1.0:1789081497.419238:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f076caf3/0xb7cb3d7479d5f4fe lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 6269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081497.419261:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d4df4081/0xb7cb3d7479d5f50c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f505 expref: 12 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081497.419269:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d4df4081, rc 0) 00000100:00100000:1.0:1789081497.419370:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023069ef6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:5786:x1875987821236352:12345-0@lo:101: Request processed in 5798us (5920us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081497.419379:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789081497.419768:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000035c7754d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821236352:0@lo:101: 00010000:00010000:3.0:1789081497.419789:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: 0000000078ab9c5a/0xb7cb3d7479d5f505 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f50c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081497.419877:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d3399799 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821236608:0@lo:501: 00000100:00100000:3.0:1789081497.419993:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081497.420069:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set 00000000526e1fa8 going to sleep for 11 seconds 00000100:00100000:1.0:1789081497.420276:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821236608 00000100:00100000:1.0:1789081497.420283:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821236608 00000100:00100000:1.0:1789081497.420335:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789081497.420344:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064ff2ad7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:5786:x1875987821236608:12345-0@lo:501: 00000100:00100000:1.0:1789081497.422253:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064ff2ad7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:5786:x1875987821236608:12345-0@lo:501: Request processed in 1901us (2252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081497.422269:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789081497.422583:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d3399799 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821236608:0@lo:501: 00000100:00100000:0.0:1789081497.422675:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000088a8f9fd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821236736:0@lo:503: 00000100:00100000:0.0:1789081497.422731:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081497.422768:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821236736 00000100:00100000:0.0:1789081497.422774:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set 000000007f24ef2e going to sleep for 11 seconds 00000100:00100000:1.0:1789081497.422776:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821236736 00000100:00100000:1.0:1789081497.422832:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789081497.422913:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005658f1ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:5786:x1875987821236736:12345-0@lo:503: 00000100:00100000:1.0:1789081497.423323:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005658f1ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:5786:x1875987821236736:12345-0@lo:503: Request processed in 413us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081497.423333:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789081497.423387:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000088a8f9fd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821236736:0@lo:503: 00000100:00100000:1.0:1789081497.427777:0:6271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004e10a732 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:6271:1875987821236864:0@lo:502: 00000100:00100000:1.0:1789081497.427904:0:6271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081497.427962:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821236864 00000100:00100000:3.0:1789081497.427974:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821236864 00000100:00100000:1.0:1789081497.427977:0:6271:0:(client.c:2702:ptlrpc_set_wait()) set 0000000096626072 going to sleep for 11 seconds 00000100:00100000:3.0:1789081497.428098:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789081497.428111:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a7ed38ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:6271:x1875987821236864:12345-0@lo:502: 00000100:00100000:3.0:1789081497.428398:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a7ed38ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:6271:x1875987821236864:12345-0@lo:502: Request processed in 290us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081497.428408:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789081497.429646:0:6271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004e10a732 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:6271:1875987821236864:0@lo:502: 00000020:01000000:0.0:1789081497.429705:0:6271:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789081497.429718:0:6271:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789081497.429720:0:6271:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789081497.429727:0:6271:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e10ee974800 00000020:00000080:0.0:1789081497.429732:0:6271:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789081497.429804:0:6271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:6271:1875987821236992:0@lo:502: 00000100:00100000:0.0:1789081497.430244:0:6271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081497.430300:0:6271:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d2d13840 going to sleep for 11 seconds 00000100:00100000:1.0:1789081497.430549:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821236992 00000100:00100000:1.0:1789081497.430559:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821236992 00000100:00100000:1.0:1789081497.430612:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789081497.430621:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:6271:x1875987821236992:12345-0@lo:502: 00000100:00100000:1.0:1789081497.430960:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:6271:x1875987821236992:12345-0@lo:502: Request processed in 338us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081497.430969:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789081497.430991:0:6271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:6271:1875987821236992:0@lo:502: 00000020:01000000:3.0:1789081497.431030:0:6271:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789081497.431037:0:6271:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789081497.431040:0:6271:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789081497.431046:0:6271:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1789081497.432202:0:5786:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789081497.432246:0:5786:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789081497.432261:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae400/0xb7cb3d7479d5f505 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f50c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081497.432290:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae400/0xb7cb3d7479d5f505 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f50c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081498.396934:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081499.422012:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081500.450148:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789081500.512285:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821237120:0@lo:400: 00000100:00100000:0.0:1789081500.512396:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081500.512481:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789081500.512487:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875987821237248:0@lo:400: 00000100:00100000:0.0:1789081500.512552:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081500.512591:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821237120 00000100:00100000:0.0:1789081500.512600:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821237120 00000100:00100000:0.0:1789081500.512652:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789081500.512661:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:3305:x1875987821237120:12345-0@lo:400: 00000100:00100000:0.0:1789081500.512712:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:3305:x1875987821237120:12345-0@lo:400: Request processed in 51us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081500.512720:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789081500.512758:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821237248 00000100:00100000:0.0:1789081500.512762:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821237248 00000100:00100000:0.0:1789081500.512792:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789081500.512799:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875987821237248:12345-0@lo:400: 00000100:00100000:0.0:1789081500.512833:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875987821237248:12345-0@lo:400: Request processed in 35us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081500.512839:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789081500.512883:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e11010b7800 x1875987821237248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789081516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081500.512901:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875987821237248:0@lo:400: 00000100:00100000:0.0:1789081500.512925:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821237120:0@lo:400: 00010000:00010000:3.0:1789081501.476594:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081502.493199:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081503.518717:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789081504.156293:0:6579:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789081504.156299:0:6579:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1789081504.156462:0:6579:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9e10fad3e000 00000020:01000004:1.0:1789081504.156484:0:6579:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1789081504.156499:0:6579:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789081504.156516:0:6579:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9e10f9693380) 00000020:00000080:1.0:1789081504.156600:0:6579:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789081504.185461:0:6579:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1789081504.186017:0:6579:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789081504.222294:0:6579:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789081504.231255:0:6579:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789081504.231347:0:6579:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789081504.231449:0:6579:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789081504.231479:0:6579:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789081504.232425:0:6579:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789081504.232440:0:6579:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789081504.232456:0:6579:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb7cb3d7479d5f51a 00000020:01000004:3.0:1789081504.232466:0:6579:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789081504.232495:0:6579:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.117@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789081504.232499:0:6579:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.117@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789081504.232505:0:6579:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789081504.232510:0:6579:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789081504.232649:0:6579:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9e1101c619c0) 00000020:00000080:3.0:1789081504.232664:0:6579:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1789081504.234625:0:6579:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789081504.234958:0:6579:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789081504.234965:0:6579:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789081504.236264:0:6579:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789081504.236276:0:6579:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1789081504.243348:0:6579:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1789081504.243378:0:6579:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789081504.254262:0:6579:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789081504.254763:0:6579:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789081504.254772:0:6579:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789081504.255862:0:6579:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789081504.255878:0:6579:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789081504.283707:0:6579:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789081504.284335:0:6579:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789081504.284352:0:6579:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789081504.289988:0:6579:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789081504.290014:0:6579:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789081504.292196:0:6579:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789081504.292215:0:6579:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789081504.295421:0:6579:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789081504.295709:0:6579:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789081504.295726:0:6579:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789081504.296955:0:6579:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789081504.296966:0:6579:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1789081504.360158:0:6579:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789081504.360398:0:6579:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1789081504.360406:0:6579:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1789081504.361837:0:6579:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1789081504.361852:0:6579:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1789081504.362411:0:6579:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1789081504.362442:0:6579:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1789081504.362450:0:6579:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.117@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789081504.384506:0:6579:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.117@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789081504.385758:0:6579:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.117@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1789081504.385766:0:6579:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789081504.385768:0:6579:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789081504.385769:0:6579:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789081504.385770:0:6579:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789081504.385772:0:6579:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789081504.385774:0:6579:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789081504.385776:0:6579:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789081504.385777:0:6579:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789081504.385779:0:6579:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789081504.385780:0:6579:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789081504.385782:0:6579:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789081504.385787:0:6579:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1789081504.385790:0:6579:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789081504.385791:0:6579:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789081504.385793:0:6579:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789081504.385794:0:6579:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789081504.385795:0:6579:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789081504.385796:0:6579:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789081504.385797:0:6579:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789081504.385798:0:6579:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789081504.385799:0:6579:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789081504.385800:0:6579:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789081504.385801:0:6579:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789081504.385832:0:6579:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789081504.385856:0:6579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9487480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:6579:1875987821237376:0@lo:253: 00000100:00100000:2.0:1789081504.385967:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081504.386030:0:6579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d0ff8240 going to sleep for 11 seconds 00000100:00100000:1.0:1789081504.386124:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821237376 00000100:00100000:1.0:1789081504.386133:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821237376 00000100:00100000:1.0:1789081504.386197:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789081504.386206:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:6579:x1875987821237376:12345-0@lo:253: 20000000:01000000:1.0:1789081504.386239:0:5782:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789081504.386243:0:5782:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1789081504.386248:0:5782:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1789081504.386253:0:5782:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1789081504.387764:0:5782:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789081504.388166:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1789081504.388200:0:5782:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1789081504.388297:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1789081504.388312:0:5782:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1789081504.388388:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1789081504.388461:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1789081504.389069:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1789081504.389718:0:5782:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.117@tcp 20000000:01000000:1.0:1789081504.389723:0:5782:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.117@tcp (null) (null) (null) 00000040:00080000:1.0:1789081504.389851:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1789081504.389862:0:5782:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789081504.389957:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1789081504.389972:0:5782:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.117@tcp (null) (null) 00000040:00080000:1.0:1789081504.390007:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1789081504.390016:0:5782:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789081504.390048:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1789081504.390112:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1789081504.391129:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1789081504.391156:0:5782:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.117@tcp 20000000:01000000:1.0:1789081504.391160:0:5782:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.117@tcp (null) (null) (null) 00000040:00080000:1.0:1789081504.391195:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1789081504.391202:0:5782:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789081504.391232:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1789081504.391238:0:5782:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.117@tcp (null) (null) 00000040:00080000:1.0:1789081504.391299:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1789081504.391309:0:5782:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789081504.391344:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1789081504.391379:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1789081504.391398:0:5782:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789081504.391402:0:5782:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789081504.391408:0:5782:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789081504.391426:0:5782:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789081504.391429:0:5782:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789081504.391472:0:5782:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789081504.391475:0:5782:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789081504.392835:0:6594:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1789081504.392965:0:6594:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1789081504.393018:0:6594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1789081504.393517:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1789081504.393753:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1789081504.393840:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1789081504.393855:0:5782:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789081504.393858:0:5782:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789081504.394455:0:6595:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:1.0:1789081504.394513:0:6595:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:1.0:1789081504.394642:0:6595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1789081504.394984:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1789081504.395028:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1789081504.395061:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1789081504.395073:0:5782:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789081504.395084:0:5782:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789081504.395718:0:6596:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1789081504.395988:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1789081504.396031:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1789081504.396127:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1789081504.396144:0:5782:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1789081504.396146:0:5782:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1789081504.396157:0:5782:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789081504.396177:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e1102044800/0xb7cb3d7479d5f528 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081504.396196:0:5782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e10c29e1e00/0xb7cb3d7479d5f441 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f43a expref: 12 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081504.396205:0:5782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e10c0030a00/0xb7cb3d7479d5f45d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f456 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081504.396213:0:5782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e10c29e1600/0xb7cb3d7479d5f4cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f4c6 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081504.396219:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e1102044800/0xb7cb3d7479d5f528 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081504.396260:0:5782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e10c29e1600/0xb7cb3d7479d5f4cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb7cb3d7479d5f4c6 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081504.396277:0:5782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e10c29e1600/0xb7cb3d7479d5f4cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f4c6 expref: 12 pid: 5784 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081504.396291:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c50b9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5782:1875987821237504:0@lo:104: 00000100:00100000:3.0:1789081504.396366:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789081504.396470:0:5782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e10c0030a00/0xb7cb3d7479d5f45d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb7cb3d7479d5f456 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081504.396488:0:5782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e10c0030a00/0xb7cb3d7479d5f45d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f456 expref: 12 pid: 5783 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081504.396498:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c50baa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5782:1875987821237632:0@lo:104: 00000100:00100000:3.0:1789081504.396608:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789081504.396780:0:5782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e10c29e1e00/0xb7cb3d7479d5f441 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb7cb3d7479d5f43a expref: 12 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081504.396789:0:5782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e10c29e1e00/0xb7cb3d7479d5f441 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f43a expref: 12 pid: 5782 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081504.396801:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c50b9f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5782:1875987821237760:0@lo:104: 00000100:00100000:3.0:1789081504.396847:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081504.396915:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821237504 00000100:00100000:2.0:1789081504.396923:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821237504 00000100:00100000:2.0:1789081504.396962:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821237632 00000100:00100000:2.0:1789081504.396965:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821237632 00000100:00100000:2.0:1789081504.396981:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789081504.396989:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+4:5782:x1875987821237504:12345-0@lo:104: 00010000:00010000:2.0:1789081504.397004:0:5772:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.117@tcp lock: ffff9e10c0031000/0xb7cb3d7479d5f4c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f4cd expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081504.397129:0:5772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789081504.397135:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+4:5782:x1875987821237504:12345-0@lo:104: Request processed in 147us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081504.397143:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789081504.397161:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789081504.397166:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+3:5782:x1875987821237632:12345-0@lo:104: 00010000:00010000:2.0:1789081504.397174:0:5772:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.117@tcp lock: ffff9e10e13aee00/0xb7cb3d7479d5f456 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f45d expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081504.397238:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c52e4180 going to sleep for 11 seconds 00000100:00100000:3.0:1789081504.397263:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c50b9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5782:1875987821237504:0@lo:104: 00000100:00100000:3.0:1789081504.397272:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c50baa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5782:1875987821237632:0@lo:104: 00010000:00010000:0.0:1789081504.399353:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789081504.399372:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e10c0031000/0xb7cb3d7479d5f4c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f4cd expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.399384:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10c0031000 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:0.0:1789081504.399389:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e10c0031000/0xb7cb3d7479d5f4c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb7cb3d7479d5f4cd expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.399401:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e10c0031000/0xb7cb3d7479d5f4c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb7cb3d7479d5f4cd expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789081504.399409:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e10c0031000/0xb7cb3d7479d5f4c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb7cb3d7479d5f4cd expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789081504.399415:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789081504.399475:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e10c0031000/0xb7cb3d7479d5f4c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f4cd expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.399482:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789081504.399509:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e10c0031000/0xb7cb3d7479d5f4c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f4cd expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.399517:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e10c0031000/0xb7cb3d7479d5f4c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f4cd expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.399561:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789081504.399565:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e10e13aee00/0xb7cb3d7479d5f456 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f45d expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.399588:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13aee00 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:0.0:1789081504.399591:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e10e13aee00/0xb7cb3d7479d5f456 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb7cb3d7479d5f45d expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.399598:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e10e13aee00/0xb7cb3d7479d5f456 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb7cb3d7479d5f45d expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789081504.399604:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e10e13aee00/0xb7cb3d7479d5f456 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb7cb3d7479d5f45d expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789081504.399608:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789081504.399622:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e10e13aee00/0xb7cb3d7479d5f456 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f45d expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.399627:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789081504.399633:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e10e13aee00/0xb7cb3d7479d5f456 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f45d expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.399640:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e10e13aee00/0xb7cb3d7479d5f456 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f45d expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.399649:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081504.399651:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081504.399653:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789081504.399696:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee551687-7675-4fc6-9be1-2ccb62bdd809:3303:1875987821237888:0@lo:103: 00000100:00100000:0.0:1789081504.399792:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081504.399840:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789081504.399846:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee551687-7675-4fc6-9be1-2ccb62bdd809:3303:1875987821238016:0@lo:103: 00000100:00100000:0.0:1789081504.399879:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081504.400021:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821237888 00000100:00100000:0.0:1789081504.400027:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821237888 00010000:00010000:0.0:1789081504.400062:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e10c29e1600/0xb7cb3d7479d5f4cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f4c6 expref: 13 pid: 5784 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081504.400089:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821238016 00000100:00100000:0.0:1789081504.400092:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821238016 00010000:00010000:0.0:1789081504.400118:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e10c0030a00/0xb7cb3d7479d5f45d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f456 expref: 14 pid: 5783 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081504.400135:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789081504.400143:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:3303:x1875987821237888:12345-0@lo:103: 00010000:00010000:0.0:1789081504.400158:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789081504.400165:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e10c29e1600/0xb7cb3d7479d5f4cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f4c6 expref: 14 pid: 5784 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.400176:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e10c29e1600/0xb7cb3d7479d5f4cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f4c6 expref: 14 pid: 5784 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.400192:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10c29e1600/0xb7cb3d7479d5f4cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb7cb3d7479d5f4c6 expref: 14 pid: 5784 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.400208:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789081504.400248:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:3303:x1875987821237888:12345-0@lo:103: Request processed in 105us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081504.400254:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789081504.400273:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789081504.400280:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:3303:x1875987821238016:12345-0@lo:103: 00010000:00010000:0.0:1789081504.400288:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789081504.400298:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e10c0030a00/0xb7cb3d7479d5f45d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f456 expref: 12 pid: 5783 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.400308:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e10c0030a00/0xb7cb3d7479d5f45d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f456 expref: 12 pid: 5783 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.400318:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10c0030a00/0xb7cb3d7479d5f45d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb7cb3d7479d5f456 expref: 12 pid: 5783 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.400328:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789081504.400351:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+11:3303:x1875987821238016:12345-0@lo:103: Request processed in 72us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081504.400357:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789081504.400393:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee551687-7675-4fc6-9be1-2ccb62bdd809:3303:1875987821238016:0@lo:103: 00000100:00100000:0.0:1789081504.400402:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee551687-7675-4fc6-9be1-2ccb62bdd809:3303:1875987821237888:0@lo:103: 00010000:00010000:2.0:1789081504.404735:0:5772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1789081504.404766:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+3:5782:x1875987821237632:12345-0@lo:104: Request processed in 7589us (8232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081504.404783:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789081504.404829:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821237760 00000100:00100000:2.0:1789081504.404842:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821237760 00000100:00100000:2.0:1789081504.404886:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789081504.404894:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+3:5782:x1875987821237760:12345-0@lo:104: 00010000:00010000:2.0:1789081504.404910:0:5772:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.117@tcp lock: ffff9e10c0030800/0xb7cb3d7479d5f43a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f441 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081504.405063:0:5772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789081504.405070:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+3:5782:x1875987821237760:12345-0@lo:104: Request processed in 177us (8224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081504.405076:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1789081504.405152:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789081504.405160:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e10c0030800/0xb7cb3d7479d5f43a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f441 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.405169:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10c0030800 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:0.0:1789081504.405173:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e10c0030800/0xb7cb3d7479d5f43a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb7cb3d7479d5f441 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.405183:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e10c0030800/0xb7cb3d7479d5f43a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb7cb3d7479d5f441 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789081504.405191:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e10c0030800/0xb7cb3d7479d5f43a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb7cb3d7479d5f441 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789081504.405197:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789081504.405260:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e10c0030800/0xb7cb3d7479d5f43a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f441 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.405267:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789081504.405290:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e10c0030800/0xb7cb3d7479d5f43a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f441 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.405298:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e10c0030800/0xb7cb3d7479d5f43a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f441 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.405319:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081504.405321:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081504.405322:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789081504.405338:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821238144:0@lo:103: 00000100:00100000:0.0:1789081504.405385:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081504.405449:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821238144 00000100:00100000:0.0:1789081504.405454:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821238144 00010000:00010000:0.0:1789081504.405477:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e10c29e1e00/0xb7cb3d7479d5f441 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f43a expref: 11 pid: 5782 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081504.405500:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789081504.405507:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+11:3305:x1875987821238144:12345-0@lo:103: 00010000:00010000:0.0:1789081504.405519:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789081504.405552:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e10c29e1e00/0xb7cb3d7479d5f441 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f43a expref: 11 pid: 5782 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.405563:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e10c29e1e00/0xb7cb3d7479d5f441 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f43a expref: 11 pid: 5782 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.405586:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e1102044800/0xb7cb3d7479d5f528 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.405603:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e1102044800/0xb7cb3d7479d5f528 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.405622:0:5774:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e1102044800/0xb7cb3d7479d5f528 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.405629:0:5774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e1102044800/0xb7cb3d7479d5f528 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.405636:0:5774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e1102044800/0xb7cb3d7479d5f528 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.405642:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e1102044800/0xb7cb3d7479d5f528 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.405647:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1102044800 already unused, calling callback (ffffffffc1784220) 00010000:00010000:0.0:1789081504.405651:0:5774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e1102044800/0xb7cb3d7479d5f528 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.405658:0:5774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e1102044800/0xb7cb3d7479d5f528 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.405667:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e1102044800/0xb7cb3d7479d5f528 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.405677:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789081504.405708:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+11:3305:x1875987821238144:12345-0@lo:103: Request processed in 201us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081504.405716:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789081504.405757:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821238144:0@lo:103: 00010000:00010000:0.0:1789081504.405801:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10c29e1e00/0xb7cb3d7479d5f441 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb7cb3d7479d5f43a expref: 10 pid: 5782 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081504.405813:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c50b9f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5782:1875987821237760:0@lo:104: 00010000:00010000:0.0:1789081504.405833:0:5782:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e1102044800/0xb7cb3d7479d5f528 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.405842:0:5782:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e1102044800/0xb7cb3d7479d5f528 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.405848:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e1102044800/0xb7cb3d7479d5f528 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.405854:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e1102044800/0xb7cb3d7479d5f528 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789081504.405869:0:5782:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:3.0:1789081504.408268:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789081504.525566:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+9:6579:x1875987821237376:12345-0@lo:253: Request processed in 139348us (139587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081504.525585:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789081504.525715:0:6579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9487480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:6579:1875987821237376:0@lo:253: 10000000:01000000:3.0:1789081504.525735:0:6579:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789081504.525738:0:6579:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789081504.525740:0:6579:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789081504.525742:0:6579:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789081504.525743:0:6579:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1789081504.525744:0:6579:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789081504.525745:0:6579:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789081504.525746:0:6579:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789081504.525748:0:6579:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789081504.525749:0:6579:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789081504.525751:0:6579:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789081504.525796:0:6579:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e10fad3e000 from lustre-OST0000 10000000:01000000:3.0:1789081504.525840:0:6579:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789081504.525844:0:6579:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789081504.525854:0:6579:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e10d1a03380 local copy 10000000:01000000:3.0:1789081504.525859:0:6579:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789081504.526051:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1102044400/0xb7cb3d7479d5f52f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081504.526064:0:6579:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.117@tcp lock: ffff9e1102044400/0xb7cb3d7479d5f52f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081504.526075:0:6579:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e1102044400/0xb7cb3d7479d5f52f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081504.526107:0:6579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c50b9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:6579:1875987821238272:0@lo:101: 00000100:00100000:3.0:1789081504.526155:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081504.526253:0:6579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c52e4180 going to sleep for 11 seconds 00000100:00100000:0.0:1789081504.530039:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821238272 00000100:00100000:0.0:1789081504.530060:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821238272 00000100:00100000:2.0:1789081504.530264:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789081504.530277:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+9:6579:x1875987821238272:12345-0@lo:101: 00010000:00010000:2.0:1789081504.530298:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081504.530325:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10c29e0e00/0xb7cb3d7479d5f536 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f52f expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081504.530358:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10c29e0e00/0xb7cb3d7479d5f536 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f52f expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081504.530370:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10c29e0e00/0xb7cb3d7479d5f536 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f52f expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081504.530379:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10c29e0e00, rc 0) 00000100:00100000:2.0:1789081504.530494:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+10:6579:x1875987821238272:12345-0@lo:101: Request processed in 220us (4338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081504.530502:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789081504.530747:0:6579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c50b9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:6579:1875987821238272:0@lo:101: 00010000:00010000:0.0:1789081504.530771:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e1102044400/0xb7cb3d7479d5f52f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xb7cb3d7479d5f536 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.530781:0:6579:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e1102044400/0xb7cb3d7479d5f52f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb7cb3d7479d5f536 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081504.531024:0:6579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:6579:1875987821238400:0@lo:501: 00000100:00100000:0.0:1789081504.531067:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081504.531125:0:6579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c30149c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789081504.531208:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821238400 00000100:00100000:2.0:1789081504.531214:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821238400 00000100:00100000:2.0:1789081504.531292:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789081504.531300:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+10:6579:x1875987821238400:12345-0@lo:501: 00000100:00100000:2.0:1789081504.531563:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+10:6579:x1875987821238400:12345-0@lo:501: Request processed in 263us (495us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789081504.531570:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789081504.531634:0:6579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:6579:1875987821238400:0@lo:501: 10000000:01000000:0.0:1789081504.531648:0:6579:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.117@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789081504.531674:0:6579:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.117@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789081504.531679:0:6579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1102044400/0xb7cb3d7479d5f52f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb7cb3d7479d5f536 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.531686:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1102044400/0xb7cb3d7479d5f52f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb7cb3d7479d5f536 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.531693:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.117@tcp lock: ffff9e1102044400/0xb7cb3d7479d5f52f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb7cb3d7479d5f536 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.531721:0:6579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789081504.531743:0:6579:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e10fad3e000 10000000:01000000:0.0:1789081504.531749:0:6579:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789081504.531755:0:6579:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9e10d1a03380 10000000:01000000:0.0:1789081504.531757:0:6579:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1789081504.531761:0:6579:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9e10d1a03380 from 1 10000000:01000000:0.0:1789081504.531764:0:6579:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789081504.531788:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c0030800/0xb7cb3d7479d5f53d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.531797:0:6579:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e10c0030800/0xb7cb3d7479d5f53d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.531805:0:6579:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e10c0030800/0xb7cb3d7479d5f53d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081504.531818:0:6579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:6579:1875987821238528:0@lo:101: 00000100:00100000:0.0:1789081504.531846:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789081504.531908:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789081504.531917:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e1102044400/0xb7cb3d7479d5f52f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xb7cb3d7479d5f536 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081504.531931:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1102044400 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:1.0:1789081504.531935:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e1102044400/0xb7cb3d7479d5f52f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xb7cb3d7479d5f536 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081504.531943:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e1102044400/0xb7cb3d7479d5f52f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xb7cb3d7479d5f536 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789081504.531950:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e1102044400/0xb7cb3d7479d5f52f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xb7cb3d7479d5f536 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789081504.531955:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789081504.531975:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e1102044400/0xb7cb3d7479d5f52f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xb7cb3d7479d5f536 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081504.531981:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789081504.532001:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e1102044400/0xb7cb3d7479d5f52f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xb7cb3d7479d5f536 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081504.532008:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e1102044400/0xb7cb3d7479d5f52f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xb7cb3d7479d5f536 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081504.532026:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081504.532028:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081504.532030:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789081504.534636:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101c30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821238656:0@lo:103: 00000100:00100000:1.0:1789081504.534738:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081504.535009:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821238656 00000100:00100000:0.0:1789081504.535019:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821238656 00000100:00100000:0.0:1789081504.535081:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789081504.535090:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee551687-7675-4fc6-9be1-2ccb62bdd809+10:3306:x1875987821238656:12345-0@lo:103: 00010000:00010000:0.0:1789081504.535119:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789081504.535142:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10c29e0e00/0xb7cb3d7479d5f536 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb7cb3d7479d5f52f expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.535162:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789081504.535201:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee551687-7675-4fc6-9be1-2ccb62bdd809+9:3306:x1875987821238656:12345-0@lo:103: Request processed in 113us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081504.535209:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789081504.535259:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101c30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821238656:0@lo:103: 00000100:00100000:0.0:1789081504.535282:0:6579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c3014780 going to sleep for 11 seconds 00000100:00100000:3.0:1789081504.539565:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821238528 00000100:00100000:3.0:1789081504.539588:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821238528 00000100:00100000:3.0:1789081504.539662:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789081504.539673:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+9:6579:x1875987821238528:12345-0@lo:101: 00010000:00010000:3.0:1789081504.539696:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081504.539724:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e1102044e00/0xb7cb3d7479d5f544 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f53d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081504.539759:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e1102044e00/0xb7cb3d7479d5f544 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f53d expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081504.539771:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e1102044e00/0xb7cb3d7479d5f544 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f53d expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081504.539804:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1102044e00, rc 0) 00000100:00100000:3.0:1789081504.539928:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+10:6579:x1875987821238528:12345-0@lo:101: Request processed in 256us (8080us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081504.539935:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789081504.540179:0:6579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:6579:1875987821238528:0@lo:101: 00010000:00010000:0.0:1789081504.540207:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e10c0030800/0xb7cb3d7479d5f53d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f544 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.540218:0:6579:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e10c0030800/0xb7cb3d7479d5f53d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f544 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789081504.540245:0:6579:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789081504.540261:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c0030800/0xb7cb3d7479d5f53d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f544 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.540270:0:6579:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e10c0030800/0xb7cb3d7479d5f53d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f544 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789081504.540280:0:6579:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789081504.540292:0:6579:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789081504.540300:0:6579:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789081504.540303:0:6579:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789081504.540334:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c0030a00/0xb7cb3d7479d5f54b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.540342:0:6579:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e10c0030a00/0xb7cb3d7479d5f54b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.540350:0:6579:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e10c0030a00/0xb7cb3d7479d5f54b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081504.540370:0:6579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:6579:1875987821238784:0@lo:101: 00000100:00100000:0.0:1789081504.540410:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081504.540453:0:6579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c3014780 going to sleep for 11 seconds 00000100:00100000:3.0:1789081504.540562:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821238784 00000100:00100000:3.0:1789081504.540567:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821238784 00000100:00100000:3.0:1789081504.540590:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789081504.540597:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+10:6579:x1875987821238784:12345-0@lo:101: 00010000:00010000:3.0:1789081504.540605:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081504.540615:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e1102044000/0xb7cb3d7479d5f552 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f54b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081504.540629:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e1102044000/0xb7cb3d7479d5f552 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f54b expref: 11 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081504.540638:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e1102044000/0xb7cb3d7479d5f552 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f54b expref: 11 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081504.540645:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1102044000, rc 0) 00000100:00100000:3.0:1789081504.540681:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+11:6579:x1875987821238784:12345-0@lo:101: Request processed in 83us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081504.540687:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789081504.540779:0:6579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:6579:1875987821238784:0@lo:101: 00010000:00010000:0.0:1789081504.540790:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e10c0030a00/0xb7cb3d7479d5f54b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f552 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.540798:0:6579:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e10c0030a00/0xb7cb3d7479d5f54b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f552 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081504.540924:0:6579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:6579:1875987821238912:0@lo:501: 00000100:00100000:0.0:1789081504.540951:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081504.540970:0:6579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c3014780 going to sleep for 11 seconds 00000100:00100000:3.0:1789081504.542649:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821238912 00000100:00100000:3.0:1789081504.542673:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821238912 00000100:00100000:3.0:1789081504.542743:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789081504.542755:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+11:6579:x1875987821238912:12345-0@lo:501: 00000100:00100000:3.0:1789081504.543397:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+11:6579:x1875987821238912:12345-0@lo:501: Request processed in 643us (2442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081504.543415:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789081504.543593:0:6579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:6579:1875987821238912:0@lo:501: 00000100:00100000:0.0:1789081504.543656:0:6579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:6579:1875987821239040:0@lo:503: 00000100:00100000:0.0:1789081504.543709:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081504.543757:0:6579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c3014780 going to sleep for 11 seconds 00000100:00100000:3.0:1789081504.544159:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821239040 00000100:00100000:3.0:1789081504.544166:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821239040 00000100:00100000:3.0:1789081504.544199:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789081504.544207:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+11:6579:x1875987821239040:12345-0@lo:503: 00000100:00100000:3.0:1789081504.544414:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+11:6579:x1875987821239040:12345-0@lo:503: Request processed in 207us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081504.544422:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789081504.545190:0:6579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:6579:1875987821239040:0@lo:503: 00000040:00080000:0.0:1789081504.545615:0:6579:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789081504.545712:0:6579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:6579:1875987821239168:0@lo:502: 00000100:00100000:0.0:1789081504.545785:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081504.545829:0:6579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c3014780 going to sleep for 11 seconds 00000100:00100000:3.0:1789081504.549566:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821239168 00000100:00100000:3.0:1789081504.549591:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821239168 00000100:00100000:3.0:1789081504.549682:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789081504.549696:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+11:6579:x1875987821239168:12345-0@lo:502: 00000100:00100000:3.0:1789081504.550112:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+11:6579:x1875987821239168:12345-0@lo:502: Request processed in 418us (4326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081504.550122:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789081504.550382:0:6579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:6579:1875987821239168:0@lo:502: 00000040:00080000:0.0:1789081504.550747:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789081504.550811:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789081504.550845:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789081504.550911:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789081504.550949:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789081504.550984:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789081504.551027:0:6579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:6579:1875987821239296:0@lo:502: 00000100:00100000:0.0:1789081504.551090:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081504.551141:0:6579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c3014780 going to sleep for 11 seconds 00000100:00100000:2.0:1789081504.551468:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821239296 00000100:00100000:2.0:1789081504.551476:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821239296 00000100:00100000:2.0:1789081504.551550:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789081504.551560:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+11:6579:x1875987821239296:12345-0@lo:502: 00000100:00100000:2.0:1789081504.551777:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+11:6579:x1875987821239296:12345-0@lo:502: Request processed in 218us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081504.551785:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:3.0:1789081504.551942:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789081504.552082:0:6579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:6579:1875987821239296:0@lo:502: 00000040:00080000:0.0:1789081504.552237:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789081504.552250:0:6579:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1789081504.552747:0:6597:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789081504.552758:0:6597:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1789081504.552766:0:6597:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789081504.552769:0:6597:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789081504.552776:0:6597:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789081504.552804:0:6597:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9e10ff7d0000) 00000020:00000080:2.0:1789081504.552831:0:6597:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789081504.552839:0:6597:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789081504.553265:0:6597:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e10fad3e000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789081504.553274:0:6597:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789081504.553283:0:6597:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb7cb3d7479d5f560 00010000:00010000:3.0:1789081504.580118:0:6597:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1789081504.580792:0:6597:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1789081504.588855:0:6597:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789081504.589368:0:6597:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1789081504.614875:0:6597:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1789081504.615441:0:6597:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1789081504.626755:0:6597:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789081504.626775:0:6597:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789081504.626783:0:6597:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789081504.626791:0:6597:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789081504.626795:0:6597:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789081504.626800:0:6597:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789081504.626802:0:6597:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789081504.626805:0:6597:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789081504.626807:0:6597:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789081504.626885:0:6597:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789081504.626889:0:6597:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789081504.626890:0:6597:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789081504.630143:0:6597:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789081504.632027:0:6579:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1789081504.632076:0:6579:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789081504.632162:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c0030a00/0xb7cb3d7479d5f54b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f552 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081504.632193:0:6579:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e10c0030a00/0xb7cb3d7479d5f54b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f552 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789081504.632203:0:6579:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e10fad3e000 from 1 10000000:01000000:3.0:1789081504.632206:0:6579:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789081504.632279:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1102044400/0xb7cb3d7479d5f567 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081504.632288:0:6579:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e1102044400/0xb7cb3d7479d5f567 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081504.632301:0:6579:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e1102044400/0xb7cb3d7479d5f567 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081504.632331:0:6579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c50bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:6579:1875987821239424:0@lo:101: 00000100:00100000:3.0:1789081504.632506:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081504.632601:0:6579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c31ff600 going to sleep for 11 seconds 00000100:00100000:1.0:1789081504.633902:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821239424 00000100:00100000:1.0:1789081504.633918:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821239424 00000100:00100000:1.0:1789081504.633987:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789081504.633997:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+11:6579:x1875987821239424:12345-0@lo:101: 00010000:00010000:1.0:1789081504.634015:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081504.634033:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10e13afe00/0xb7cb3d7479d5f56e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f567 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081504.634063:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10e13afe00/0xb7cb3d7479d5f56e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f567 expref: 12 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081504.634074:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10e13afe00/0xb7cb3d7479d5f56e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f567 expref: 12 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081504.634084:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13afe00, rc 0) 00000100:00100000:1.0:1789081504.634182:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:6579:x1875987821239424:12345-0@lo:101: Request processed in 185us (1675us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081504.634189:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789081504.634258:0:6579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c50bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:6579:1875987821239424:0@lo:101: 00010000:00010000:1.0:1789081504.634280:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e1102044400/0xb7cb3d7479d5f567 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f56e expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081504.634303:0:6579:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e1102044400/0xb7cb3d7479d5f567 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f56e expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081504.635050:0:6579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101c32d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:6579:1875987821239552:0@lo:501: 00000100:00100000:1.0:1789081504.635118:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081504.635170:0:6579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c7dd59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789081504.639867:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821239552 00000100:00100000:3.0:1789081504.639885:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821239552 00000100:00100000:3.0:1789081504.639971:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789081504.639982:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:6579:x1875987821239552:12345-0@lo:501: 00000100:00100000:3.0:1789081504.640407:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:6579:x1875987821239552:12345-0@lo:501: Request processed in 414us (5276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081504.640416:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789081504.640719:0:6579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101c32d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:6579:1875987821239552:0@lo:501: 00000100:00100000:1.0:1789081504.640777:0:6579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101c32d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:6579:1875987821239680:0@lo:503: 00000100:00100000:1.0:1789081504.640831:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081504.640871:0:6579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c7dd59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789081504.641048:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821239680 00000100:00100000:3.0:1789081504.641054:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821239680 00000100:00100000:3.0:1789081504.641118:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789081504.641127:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:6579:x1875987821239680:12345-0@lo:503: 00000100:00100000:1.0:1789081504.649950:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:6579:x1875987821239680:12345-0@lo:503: Request processed in 8812us (9107us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081504.649969:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789081504.650181:0:6579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101c32d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:6579:1875987821239680:0@lo:503: 00000040:00080000:0.0:1789081504.650661:0:6579:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789081504.650981:0:6579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:6579:1875987821239808:0@lo:502: 00000100:00100000:0.0:1789081504.651064:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081504.651332:0:6579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c3014780 going to sleep for 11 seconds 00000100:00100000:1.0:1789081504.651895:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821239808 00000100:00100000:1.0:1789081504.651905:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821239808 00000100:00100000:1.0:1789081504.651959:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789081504.651968:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:6579:x1875987821239808:12345-0@lo:502: 00000100:00100000:1.0:1789081504.652280:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:6579:x1875987821239808:12345-0@lo:502: Request processed in 312us (1215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081504.652289:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789081504.652678:0:6579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:6579:1875987821239808:0@lo:502: 00000040:00080000:0.0:1789081504.653024:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1789081504.653112:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1789081504.653149:0:6579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:6579:1875987821239936:0@lo:502: 00000100:00100000:0.0:1789081504.653200:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081504.653242:0:6579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c3014780 going to sleep for 11 seconds 00000100:00100000:1.0:1789081504.653829:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821239936 00000100:00100000:1.0:1789081504.653837:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821239936 00000100:00100000:1.0:1789081504.653879:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789081504.653888:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:6579:x1875987821239936:12345-0@lo:502: 00000100:00100000:1.0:1789081504.654377:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:6579:x1875987821239936:12345-0@lo:502: Request processed in 489us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081504.654562:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789081504.654880:0:6579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:6579:1875987821239936:0@lo:502: 00000040:00080000:0.0:1789081504.655061:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789081504.655078:0:6579:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789081504.658421:0:6601:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789081504.658443:0:6601:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789081504.658446:0:6601:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789081504.658455:0:6601:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e10fad3e000 00000020:00000080:3.0:1789081504.658458:0:6601:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789081504.658485:0:6601:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789081504.658489:0:6601:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789081504.658490:0:6601:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789081504.658494:0:6601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789081504.658923:0:6579:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789081504.658956:0:6579:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789081504.658982:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1102044400/0xb7cb3d7479d5f567 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f56e expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081504.658995:0:6579:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e1102044400/0xb7cb3d7479d5f567 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f56e expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789081504.659038:0:6579:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789081504.659042:0:6579:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e10fad3e000 10000000:01000000:1.0:1789081504.659046:0:6579:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e10fad3e000 10000000:01000000:1.0:1789081504.659051:0:6579:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789081504.659057:0:6579:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e10fad3e000 from 1 10000000:01000000:1.0:1789081504.659061:0:6579:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789081504.659115:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10e13af400/0xb7cb3d7479d5f575 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081504.659123:0:6579:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e10e13af400/0xb7cb3d7479d5f575 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081504.659134:0:6579:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e10e13af400/0xb7cb3d7479d5f575 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081504.659159:0:6579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101c31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:6579:1875987821240064:0@lo:101: 00000100:00100000:1.0:1789081504.659251:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081504.659308:0:6579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c52e4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789081504.659893:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821240064 00000100:00100000:3.0:1789081504.659902:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821240064 00000100:00100000:3.0:1789081504.659957:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789081504.659969:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:6579:x1875987821240064:12345-0@lo:101: 00010000:00010000:3.0:1789081504.659983:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081504.659998:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e1102044800/0xb7cb3d7479d5f57c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f575 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081504.660023:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e1102044800/0xb7cb3d7479d5f57c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f575 expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081504.660034:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e1102044800/0xb7cb3d7479d5f57c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f575 expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081504.660042:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1102044800, rc 0) 00000100:00100000:3.0:1789081504.660101:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:6579:x1875987821240064:12345-0@lo:101: Request processed in 123us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081504.660109:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789081504.660225:0:6579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101c31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:6579:1875987821240064:0@lo:101: 00010000:00010000:0.0:1789081504.660241:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e10e13af400/0xb7cb3d7479d5f575 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f57c expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.660250:0:6579:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e10e13af400/0xb7cb3d7479d5f575 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f57c expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081504.660365:0:6579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:6579:1875987821240192:0@lo:501: 00000100:00100000:0.0:1789081504.660416:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081504.660457:0:6579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c3014780 going to sleep for 11 seconds 00000100:00100000:1.0:1789081504.660578:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821240192 00000100:00100000:1.0:1789081504.660582:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821240192 00000100:00100000:1.0:1789081504.660627:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789081504.660633:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:6579:x1875987821240192:12345-0@lo:501: 00000100:00100000:1.0:1789081504.660923:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:6579:x1875987821240192:12345-0@lo:501: Request processed in 289us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081504.660930:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789081504.661139:0:6579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:6579:1875987821240192:0@lo:501: 00000100:00100000:0.0:1789081504.661173:0:6579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:6579:1875987821240320:0@lo:503: 00000100:00100000:0.0:1789081504.661212:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081504.661248:0:6579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c3014780 going to sleep for 11 seconds 00000100:00100000:3.0:1789081504.661326:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821240320 00000100:00100000:3.0:1789081504.661332:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821240320 00000100:00100000:3.0:1789081504.661363:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789081504.661377:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:6579:x1875987821240320:12345-0@lo:503: 00000100:00100000:3.0:1789081504.661683:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:6579:x1875987821240320:12345-0@lo:503: Request processed in 306us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081504.661691:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789081504.663641:0:6579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:6579:1875987821240320:0@lo:503: 00000040:00080000:0.0:1789081504.664071:0:6579:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789081504.664169:0:6579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:6579:1875987821240448:0@lo:502: 00000100:00100000:0.0:1789081504.664256:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081504.664302:0:6579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c3014780 going to sleep for 11 seconds 00000100:00100000:0.0:1789081504.664330:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821240448 00000100:00100000:0.0:1789081504.664336:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821240448 00000100:00100000:0.0:1789081504.664371:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789081504.664380:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:6579:x1875987821240448:12345-0@lo:502: 00000100:00100000:0.0:1789081504.664654:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:6579:x1875987821240448:12345-0@lo:502: Request processed in 274us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081504.664662:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789081504.664715:0:6579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:6579:1875987821240448:0@lo:502: 00000040:00080000:0.0:1789081504.665014:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789081504.665060:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789081504.665107:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789081504.665155:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789081504.665184:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789081504.665225:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789081504.665260:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789081504.665295:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789081504.665346:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789081504.665378:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789081504.665409:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789081504.665479:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789081504.665511:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789081504.665572:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789081504.665633:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789081504.665674:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789081504.665707:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789081504.665757:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789081504.665791:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789081504.665824:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789081504.665870:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789081504.665907:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789081504.665941:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789081504.666000:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789081504.666036:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1789081504.666069:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1789081504.666132:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1789081504.666184:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1789081504.666230:0:6579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:6579:1875987821240576:0@lo:502: 00000100:00100000:0.0:1789081504.666297:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081504.666332:0:6579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c3014780 going to sleep for 11 seconds 00000100:00100000:0.0:1789081504.666364:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821240576 00000100:00100000:0.0:1789081504.666370:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821240576 00000100:00100000:0.0:1789081504.666407:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789081504.666415:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ffa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:6579:x1875987821240576:12345-0@lo:502: 00000100:00100000:0.0:1789081504.666631:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ffa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:6579:x1875987821240576:12345-0@lo:502: Request processed in 216us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081504.666638:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789081504.666690:0:6579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:6579:1875987821240576:0@lo:502: 00000040:00080000:0.0:1789081504.666758:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1789081504.666768:0:6579:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1789081504.686295:0:6602:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789081504.686319:0:6602:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9e1101c60000) 00000020:00000080:3.0:1789081504.686348:0:6602:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1789081504.688704:0:6602:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e10fad3e000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789081504.692065:0:6602:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e10fad3e000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789081504.692069:0:6602:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e10fad3e000 3 00010000:00080000:3.0:1789081504.692142:0:6602:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e10ffa8f800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.117@tcp at head 00010000:00010000:3.0:1789081504.697793:0:6602:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1789081504.697918:0:6602:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789081504.697962:0:6602:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789081504.697980:0:6602:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xb7cb3d7479d5f58a 00000100:00080000:3.0:1789081504.697994:0:6602:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789081504.698000:0:6602:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e10ffa8f800 using connection 192.168.201.117@tcp/0@lo 00000100:00100000:3.0:1789081504.698054:0:6602:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e10c50bb800 x1875987821240704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789081504.698078:0:6602:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789081504.700171:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c50bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1875987821240704:0@lo:38: 00000100:00100000:2.0:1789081504.700291:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081504.702658:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821240704 00000100:00100000:1.0:1789081504.702677:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821240704 00000100:00100000:1.0:1789081504.702744:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789081504.703304:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3302:x1875987821240704:12345-0@lo:38: 00010000:00080000:1.0:1789081504.703346:0:5790:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 171 last 0 00000020:00000080:1.0:1789081504.703408:0:5790:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xb7cb3d7479d5f591 00000004:00100000:1.0:1789081504.703431:0:5790:0:(mdt_handler.c:7406:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789081504.703471:0:5790:0:(import.c:65:import_set_state_nolock()) ffff9e10ff77f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789081504.703614:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875987821240704:12345-0@lo:38: Request processed in 860us (3323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081504.703624:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789081504.703692:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e10c50bb800 x1875987821240704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789081514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789081504.704033:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789081504.704045:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1789081504.704053:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789081504.704058:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789081504.704061:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e10ffa8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789081504.704068:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c50bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1875987821240704:0@lo:38: 00000100:00100000:0.0:1789081504.706695:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789081504.706735:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875987821240832:0@lo:400: 00000100:00100000:0.0:1789081504.707037:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081504.707114:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821240832 00000100:00100000:0.0:1789081504.707122:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821240832 00000100:00100000:0.0:1789081504.707174:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789081504.707183:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875987821240832:12345-0@lo:400: 00000100:00100000:0.0:1789081504.707253:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875987821240832:12345-0@lo:400: Request processed in 70us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081504.707261:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789081504.707318:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e11010b7100 x1875987821240832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789081520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081504.707333:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875987821240832:0@lo:400: 00000040:00080000:1.0:1789081504.725035:0:6602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1789081504.725444:0:6579:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1789081504.725490:0:6579:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789081504.725547:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10e13af400/0xb7cb3d7479d5f575 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f57c expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.725562:0:6579:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e10e13af400/0xb7cb3d7479d5f575 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f57c expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789081504.725634:0:6579:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789081504.725637:0:6579:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789081504.725639:0:6579:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789081504.725640:0:6579:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789081504.725642:0:6579:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789081504.725643:0:6579:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789081504.725645:0:6579:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789081504.725647:0:6579:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789081504.725648:0:6579:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789081504.725650:0:6579:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789081504.725652:0:6579:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789081504.725657:0:6579:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1789081504.725659:0:6579:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789081504.725661:0:6579:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789081504.725662:0:6579:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789081504.725663:0:6579:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789081504.725664:0:6579:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789081504.725665:0:6579:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789081504.725666:0:6579:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789081504.725667:0:6579:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789081504.725668:0:6579:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789081504.725669:0:6579:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789081504.725671:0:6579:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789081504.725703:0:6579:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789081504.725736:0:6579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:6579:1875987821240960:0@lo:253: 00000100:00100000:0.0:1789081504.726617:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081504.726731:0:6579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c3014780 going to sleep for 11 seconds 00000100:00100000:2.0:1789081504.731036:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821240960 00000100:00100000:2.0:1789081504.731057:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821240960 00000100:00100000:2.0:1789081504.731159:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789081504.731174:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:6579:x1875987821240960:12345-0@lo:253: 20000000:01000000:2.0:1789081504.731221:0:5782:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789081504.733548:0:5782:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789081504.799598:0:5782:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789081504.799625:0:5782:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1789081504.799665:0:5805:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789081504.799696:0:5805:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789081504.799734:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e10e13ae600/0xb7cb3d7479d5f598 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081504.799768:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e1102044200/0xb7cb3d7479d5f4f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f4f0 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081504.799781:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e10e13ae600/0xb7cb3d7479d5f598 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081504.799865:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e1102044200/0xb7cb3d7479d5f4f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb7cb3d7479d5f4f0 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081504.800079:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e1102044200/0xb7cb3d7479d5f4f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f4f0 expref: 13 pid: 5783 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081504.800111:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101c32680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5805:1875987821241088:0@lo:104: 00000100:00100000:1.0:1789081504.800224:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081504.800332:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c31d7900 going to sleep for 11 seconds 00000100:00100000:3.0:1789081504.800463:0:5772:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789081504.800487:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821241088 00000100:00100000:3.0:1789081504.800495:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821241088 00000100:00100000:3.0:1789081504.800587:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789081504.800596:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d152e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+3:5805:x1875987821241088:12345-0@lo:104: 00010000:00010000:3.0:1789081504.800617:0:5772:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.117@tcp lock: ffff9e10c0030200/0xb7cb3d7479d5f4f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f4f7 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081504.800717:0:5772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789081504.800725:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d152e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+3:5805:x1875987821241088:12345-0@lo:104: Request processed in 128us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081504.800737:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1789081504.801273:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789081504.801282:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e10c0030200/0xb7cb3d7479d5f4f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f4f7 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081504.801293:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10c0030200 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:1.0:1789081504.801297:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e10c0030200/0xb7cb3d7479d5f4f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb7cb3d7479d5f4f7 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081504.801307:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e10c0030200/0xb7cb3d7479d5f4f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb7cb3d7479d5f4f7 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789081504.801316:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e10c0030200/0xb7cb3d7479d5f4f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb7cb3d7479d5f4f7 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789081504.801329:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789081504.801374:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e10c0030200/0xb7cb3d7479d5f4f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f4f7 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081504.801381:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789081504.801417:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e10c0030200/0xb7cb3d7479d5f4f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f4f7 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081504.801440:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e10c0030200/0xb7cb3d7479d5f4f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f4f7 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081504.801462:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081504.801464:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081504.801466:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789081504.801475:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789081504.801489:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101c31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee551687-7675-4fc6-9be1-2ccb62bdd809:3303:1875987821241216:0@lo:103: 00000100:00100000:1.0:1789081504.801601:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081504.802111:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101c32680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5805:1875987821241088:0@lo:104: 00010000:00010000:1.0:1789081504.802133:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e10e13ae600/0xb7cb3d7479d5f598 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081504.802909:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821241216 00000100:00100000:0.0:1789081504.802922:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821241216 00010000:00010000:0.0:1789081504.802961:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e1102044200/0xb7cb3d7479d5f4f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f4f0 expref: 14 pid: 5783 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081504.803005:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789081504.803014:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c938a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:3303:x1875987821241216:12345-0@lo:103: 00010000:00010000:0.0:1789081504.803031:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789081504.803038:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e1102044200/0xb7cb3d7479d5f4f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f4f0 expref: 14 pid: 5783 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.803052:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e1102044200/0xb7cb3d7479d5f4f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f4f0 expref: 14 pid: 5783 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.803076:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e1102044200/0xb7cb3d7479d5f4f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb7cb3d7479d5f4f0 expref: 14 pid: 5783 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.803106:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e10e13ae600/0xb7cb3d7479d5f598 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.803118:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10e13ae600/0xb7cb3d7479d5f598 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789081504.803138:0:5775:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003443082s 00010000:00010000:0.0:1789081504.803144:0:5775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e10e13ae600/0xb7cb3d7479d5f598 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.803151:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e10e13ae600/0xb7cb3d7479d5f598 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.803174:0:5775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e10e13ae600/0xb7cb3d7479d5f598 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.803182:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e10e13ae600/0xb7cb3d7479d5f598 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.803188:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13ae600 already unused, calling callback (ffffffffc1784220) 00010000:00010000:0.0:1789081504.803192:0:5775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e10e13ae600/0xb7cb3d7479d5f598 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.803202:0:5775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e10e13ae600/0xb7cb3d7479d5f598 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.803229:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e10e13ae600/0xb7cb3d7479d5f598 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081504.803243:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789081504.803317:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c938a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:3303:x1875987821241216:12345-0@lo:103: Request processed in 303us (1719us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081504.803325:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789081504.803394:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101c31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee551687-7675-4fc6-9be1-2ccb62bdd809:3303:1875987821241216:0@lo:103: 00010000:00010000:3.0:1789081504.803397:0:5805:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e10e13ae600/0xb7cb3d7479d5f598 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081504.803412:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e10e13ae600/0xb7cb3d7479d5f598 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081504.803433:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10e13ae600/0xb7cb3d7479d5f598 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081504.822989:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:6579:x1875987821240960:12345-0@lo:253: Request processed in 91807us (97138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081504.823008:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789081504.823345:0:6579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:6579:1875987821240960:0@lo:253: 10000000:01000000:0.0:1789081504.823363:0:6579:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789081504.823366:0:6579:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789081504.823368:0:6579:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789081504.823369:0:6579:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789081504.823370:0:6579:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789081504.823372:0:6579:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789081504.823373:0:6579:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789081504.823392:0:6579:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789081504.823393:0:6579:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789081504.823394:0:6579:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789081504.823396:0:6579:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789081504.823397:0:6579:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789081504.823412:0:6579:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789081504.831371:0:6579:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789081504.831985:0:6579:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789081504.832250:0:6579:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789081504.832492:0:6579:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789081504.833102:0:6579:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789081504.833370:0:6579:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789081504.835997:0:6579:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1789081505.196110:0:6579:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789081505.196120:0:6579:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789081505.196160:0:6579:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789081505.196244:0:6579:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.117@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789081505.196262:0:6579:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789081505.196301:0:6579:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1789081505.564843:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789081505.948676:0:5786:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789081505.948689:0:5786:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e10ee974800 from 21 10000000:01000000:2.0:1789081505.948696:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789081505.948759:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0e00/0xb7cb3d7479d5f59f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081505.948769:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0e00/0xb7cb3d7479d5f59f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081505.948779:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0e00/0xb7cb3d7479d5f59f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081505.948801:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9486300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821241344:0@lo:101: 00000100:00100000:2.0:1789081505.948897:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081505.948977:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d2d13c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789081505.949155:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821241344 00000100:00100000:1.0:1789081505.949164:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821241344 00000100:00100000:1.0:1789081505.949289:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789081505.949301:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:5786:x1875987821241344:12345-0@lo:101: 00010000:00010000:1.0:1789081505.949319:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081505.949338:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10e13af200/0xb7cb3d7479d5f5a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f59f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081505.949392:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10e13af200/0xb7cb3d7479d5f5a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f59f expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081505.949405:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10e13af200/0xb7cb3d7479d5f5a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f59f expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081505.949417:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13af200, rc 0) 00000100:00100000:1.0:1789081505.949476:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:5786:x1875987821241344:12345-0@lo:101: Request processed in 178us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081505.949484:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789081505.949520:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9486300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821241344:0@lo:101: 00010000:00010000:2.0:1789081505.949573:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0e00/0xb7cb3d7479d5f59f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f5a6 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081505.949582:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0e00/0xb7cb3d7479d5f59f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f5a6 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081505.949665:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9486300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821241472:0@lo:501: 00000100:00100000:2.0:1789081505.949693:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081505.949724:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d2d13c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789081505.949831:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821241472 00000100:00100000:3.0:1789081505.949836:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821241472 00000100:00100000:3.0:1789081505.949873:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789081505.949880:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:5786:x1875987821241472:12345-0@lo:501: 00000100:00100000:3.0:1789081505.950402:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:5786:x1875987821241472:12345-0@lo:501: Request processed in 520us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081505.950422:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789081505.950677:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9486300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821241472:0@lo:501: 00000100:00100000:2.0:1789081505.950723:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9486300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821241600:0@lo:503: 00000100:00100000:2.0:1789081505.950772:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081505.950817:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d2d13c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789081505.950885:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821241600 00000100:00100000:1.0:1789081505.950965:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821241600 00000100:00100000:1.0:1789081505.951048:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789081505.951057:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:5786:x1875987821241600:12345-0@lo:503: 00000100:00100000:1.0:1789081505.951272:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:5786:x1875987821241600:12345-0@lo:503: Request processed in 216us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081505.951280:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789081505.951363:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9486300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821241600:0@lo:503: 00000100:00100000:2.0:1789081505.951931:0:6638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9486300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:6638:1875987821241728:0@lo:502: 00000100:00100000:2.0:1789081505.951980:0:6638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081505.952777:0:6638:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d2d13180 going to sleep for 11 seconds 00000100:00100000:0.0:1789081505.952884:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821241728 00000100:00100000:0.0:1789081505.952901:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821241728 00000100:00100000:1.0:1789081505.952963:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789081505.952974:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:6638:x1875987821241728:12345-0@lo:502: 00000100:00100000:1.0:1789081505.953284:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:6638:x1875987821241728:12345-0@lo:502: Request processed in 311us (1302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081505.953295:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789081505.953666:0:6638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9486300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:6638:1875987821241728:0@lo:502: 00000100:00100000:2.0:1789081505.953744:0:6638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9486300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:6638:1875987821241856:0@lo:502: 00000100:00100000:2.0:1789081505.953793:0:6638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081505.954075:0:6638:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d2d13180 going to sleep for 11 seconds 00000100:00100000:3.0:1789081505.954131:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821241856 00000100:00100000:3.0:1789081505.954137:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821241856 00000100:00100000:3.0:1789081505.954170:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789081505.954180:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ffb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:6638:x1875987821241856:12345-0@lo:502: 00000100:00100000:3.0:1789081505.954456:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ffb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:6638:x1875987821241856:12345-0@lo:502: Request processed in 277us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081505.954465:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789081505.954710:0:6638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9486300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:6638:1875987821241856:0@lo:502: 00000040:00080000:2.0:1789081505.954736:0:6638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1789081505.954997:0:5786:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1789081505.955019:0:5786:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789081505.955031:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0e00/0xb7cb3d7479d5f59f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f5a6 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081505.955043:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0e00/0xb7cb3d7479d5f59f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f5a6 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789081505.955054:0:5786:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789081505.955056:0:5786:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e10ee974800 from 4 10000000:01000000:3.0:1789081505.955060:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789081505.955109:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1102045800/0xb7cb3d7479d5f5ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081505.955119:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e1102045800/0xb7cb3d7479d5f5ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081505.955129:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e1102045800/0xb7cb3d7479d5f5ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081505.955147:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c50b8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821241984:0@lo:101: 00000100:00100000:3.0:1789081505.955184:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081505.955219:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0fc2a369c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789081505.955271:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821241984 00000100:00100000:2.0:1789081505.955277:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821241984 00000100:00100000:2.0:1789081505.955306:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789081505.955313:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:5786:x1875987821241984:12345-0@lo:101: 00010000:00010000:2.0:1789081505.955324:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081505.955341:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10c29e1e00/0xb7cb3d7479d5f5b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f5ad expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081505.955389:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10c29e1e00/0xb7cb3d7479d5f5b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f5ad expref: 14 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081505.955401:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10c29e1e00/0xb7cb3d7479d5f5b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f5ad expref: 14 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081505.955578:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10c29e1e00, rc 0) 00000100:00100000:2.0:1789081505.955616:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:5786:x1875987821241984:12345-0@lo:101: Request processed in 302us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081505.955622:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789081505.955699:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c50b8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821241984:0@lo:101: 00010000:00010000:3.0:1789081505.955713:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e1102045800/0xb7cb3d7479d5f5ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f5b4 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081505.955734:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e1102045800/0xb7cb3d7479d5f5ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f5b4 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081505.955781:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c50b8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821242112:0@lo:256: 00000100:00100000:3.0:1789081505.955832:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081505.955861:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0fc2a369c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789081505.955982:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821242112 00000100:00100000:2.0:1789081505.955988:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821242112 00000100:00100000:2.0:1789081505.956007:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789081505.956012:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:5786:x1875987821242112:12345-0@lo:256: 20000000:01000000:2.0:1789081505.956026:0:5782:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789081505.956044:0:5782:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789081505.956047:0:5782:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1789081505.956141:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:5786:x1875987821242112:12345-0@lo:256: Request processed in 127us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081505.956148:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789081505.956216:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c50b8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821242112:0@lo:256: 10000000:01000000:3.0:1789081505.956264:0:5786:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789081505.956270:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1102045800/0xb7cb3d7479d5f5ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f5b4 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081505.956278:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e1102045800/0xb7cb3d7479d5f5ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f5b4 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789081505.956287:0:5786:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789081505.956289:0:5786:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1789081505.956292:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789081505.956309:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1102045000/0xb7cb3d7479d5f5bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081505.956317:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e1102045000/0xb7cb3d7479d5f5bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081505.956325:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e1102045000/0xb7cb3d7479d5f5bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081505.956338:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c50b8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821242240:0@lo:101: 00000100:00100000:3.0:1789081505.956622:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081505.956650:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0fc2a369c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789081505.956711:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821242240 00000100:00100000:2.0:1789081505.956716:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821242240 00000100:00100000:2.0:1789081505.956746:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789081505.956753:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ff8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:5786:x1875987821242240:12345-0@lo:101: 00010000:00010000:2.0:1789081505.956762:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081505.956773:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10c29e1600/0xb7cb3d7479d5f5c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f5bb expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081505.956801:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10c29e1600/0xb7cb3d7479d5f5c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f5bb expref: 15 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081505.956811:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10c29e1600/0xb7cb3d7479d5f5c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f5bb expref: 15 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081505.956818:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10c29e1600, rc 0) 00000100:00100000:2.0:1789081505.956854:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ff8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+15:5786:x1875987821242240:12345-0@lo:101: Request processed in 102us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081505.956860:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789081505.957030:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c50b8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821242240:0@lo:101: 00010000:00010000:3.0:1789081505.957042:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e1102045000/0xb7cb3d7479d5f5bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f5c2 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081505.957051:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e1102045000/0xb7cb3d7479d5f5bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f5c2 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081505.957359:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c50b8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821242368:0@lo:501: 00000100:00100000:3.0:1789081505.957734:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081505.957797:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0fc2a369c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789081505.957837:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821242368 00000100:00100000:2.0:1789081505.957842:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821242368 00000100:00100000:2.0:1789081505.957977:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789081505.957986:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ff9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+15:5786:x1875987821242368:12345-0@lo:501: 00000100:00100000:2.0:1789081505.958329:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ff9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+15:5786:x1875987821242368:12345-0@lo:501: Request processed in 343us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081505.958338:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789081505.958431:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c50b8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821242368:0@lo:501: 00000100:00100000:3.0:1789081505.958466:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c50b8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821242496:0@lo:503: 00000100:00100000:3.0:1789081505.958510:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081505.959566:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0fc2a369c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789081505.961063:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821242496 00000100:00100000:0.0:1789081505.961091:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821242496 00000100:00100000:0.0:1789081505.961162:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789081505.961175:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ffac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+15:5786:x1875987821242496:12345-0@lo:503: 00000100:00100000:0.0:1789081505.961643:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ffac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+15:5786:x1875987821242496:12345-0@lo:503: Request processed in 469us (3130us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081505.961653:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789081505.962566:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c50b8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821242496:0@lo:503: 00000100:00100000:0.0:1789081505.962803:0:6639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:6639:1875987821242624:0@lo:502: 00000100:00100000:0.0:1789081505.962870:0:6639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081505.962925:0:6639:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c3014540 going to sleep for 11 seconds 00000100:00100000:1.0:1789081505.963052:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821242624 00000100:00100000:1.0:1789081505.963063:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821242624 00000100:00100000:1.0:1789081505.963142:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789081505.963152:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+15:6639:x1875987821242624:12345-0@lo:502: 00000100:00100000:1.0:1789081505.963666:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+15:6639:x1875987821242624:12345-0@lo:502: Request processed in 514us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081505.963676:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789081505.965649:0:6639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:6639:1875987821242624:0@lo:502: 00000020:01000000:3.0:1789081505.965705:0:6639:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789081505.965715:0:6639:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789081505.965724:0:6639:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789081505.965727:0:6639:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789081505.965738:0:6639:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789081505.965742:0:6639:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.117@tcp to nid 0x20000c0a8c975 (192.168.201.117@tcp) 00000020:01000000:3.0:1789081505.965775:0:6639:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789081505.965778:0:6639:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789081505.965806:0:6639:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9e10f9220000) 00000020:00000080:3.0:1789081505.965831:0:6639:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1789081505.965845:0:6639:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789081505.965956:0:6639:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789081505.965963:0:6639:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789081505.965970:0:6639:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb7cb3d7479d5f5d0 00010000:00080000:3.0:1789081505.966001:0:6639:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e10ffa8e800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.117@tcp at head 00010000:00010000:3.0:1789081505.966374:0:6639:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1789081506.115667:0:6639:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1789081506.115708:0:6639:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789081506.116783:0:6639:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789081506.117199:0:6639:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789081506.117258:0:6639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1789081506.117331:0:6639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1789081506.122391:0:6650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000020:00000080:3.0:1789081506.125026:0:6639:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789081506.125047:0:6639:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789081506.125104:0:6639:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789081506.125134:0:6639:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb7cb3d7479d5f5d7 00000100:00080000:3.0:1789081506.125151:0:6639:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789081506.125158:0:6639:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e10ffa8e800 using connection 192.168.201.117@tcp/0@lo 00000100:00100000:3.0:1789081506.125212:0:6639:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e10c50b8000 x1875987821242752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789081506.125241:0:6639:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789081506.125314:0:6639:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789081506.125318:0:6639:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789081506.125320:0:6639:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789081506.125323:0:6639:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789081506.125328:0:6639:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789081506.125329:0:6639:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789081506.125333:0:6639:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789081506.125335:0:6639:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789081506.125387:0:6639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c50bad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:6639:1875987821242880:0@lo:502: 00000100:00100000:3.0:1789081506.126044:0:6639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081506.126118:0:6639:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0fc2a36600 going to sleep for 11 seconds 00000100:00100000:3.0:1789081506.126156:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c50b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875987821242752:0@lo:8: 00000100:00100000:3.0:1789081506.126204:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081506.126246:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821242880 00000100:00100000:3.0:1789081506.126259:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821242880 00000100:00100000:3.0:1789081506.126309:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789081506.126318:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+15:6639:x1875987821242880:12345-0@lo:502: 00000040:00080000:1.0:1789081506.126545:0:6650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000100:00100000:0.0:1789081506.127296:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821242752 00000100:00100000:0.0:1789081506.127305:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821242752 00000100:00100000:0.0:1789081506.127340:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789081506.127349:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1875987821242752:12345-0@lo:8: 00000100:00100000:1.0:1789081506.128083:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875987821243008:0@lo:400: 00000100:00100000:1.0:1789081506.128172:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081506.128216:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789081506.128223:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875987821243136:0@lo:400: 00000100:00100000:1.0:1789081506.128246:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081506.128286:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821243008 00000100:00100000:1.0:1789081506.128291:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821243008 00000100:00100000:1.0:1789081506.128335:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821243136 00000100:00100000:1.0:1789081506.128338:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821243136 00000100:00100000:1.0:1789081506.128511:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789081506.128519:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101c32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875987821243008:12345-0@lo:400: 00000100:00100000:1.0:1789081506.128608:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101c32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875987821243008:12345-0@lo:400: Request processed in 88us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081506.128616:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789081506.128634:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789081506.128640:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101c33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875987821243136:12345-0@lo:400: 00000100:00100000:1.0:1789081506.128670:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101c33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875987821243136:12345-0@lo:400: Request processed in 30us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081506.128676:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789081506.128693:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789081506.128725:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e11010b5f80 x1875987821243136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789081522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789081506.128768:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875987821243136:0@lo:400: 00010000:00080000:1.0:1789081506.128784:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e11010b6d80 x1875987821243008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789081522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789081506.128793:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875987821243008:0@lo:400: 00000100:00100000:3.0:1789081506.129226:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+15:6639:x1875987821242880:12345-0@lo:502: Request processed in 2908us (3184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081506.129236:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:0.0:1789081506.129589:0:6581:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:0.0:1789081506.129633:0:6581:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb7cb3d7479d5f5de 00002000:00100000:0.0:1789081506.129710:0:6581:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9e10ff758000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113719 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789081506.129716:0:6581:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1789081506.129722:0:6581:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1789081506.130583:0:6581:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789081506.130781:0:6581:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789081506.130820:0:6581:0:(import.c:65:import_set_state_nolock()) ffff9e10ff759000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789081506.132674:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1875987821242752:12345-0@lo:8: Request processed in 5313us (6456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081506.132692:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789081506.134734:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e10c50b8000 x1875987821242752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789081516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789081506.134752:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789081506.134764:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789081506.134775:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789081506.134782:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789081506.134787:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e10ffa8e800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789081506.134800:0:3302:0:(osp_dev.c:1791:osp_import_event()) got connected 00000100:00100000:1.0:1789081506.134808:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c50b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875987821242752:0@lo:8: 00000004:00080000:0.0:1789081506.135055:0:6650:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789081506.135263:0:6650:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 173017737950ns, next at 0ns, rc = 0 00000100:00100000:3.0:1789081506.137661:0:6639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c50bad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:6639:1875987821242880:0@lo:502: 00000020:01000000:3.0:1789081506.137727:0:6639:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789081506.137737:0:6639:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789081506.137740:0:6639:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789081506.137752:0:6639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1789081506.139568:0:5786:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1789081506.139619:0:5786:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789081506.139634:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1102045000/0xb7cb3d7479d5f5bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f5c2 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081506.139649:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e1102045000/0xb7cb3d7479d5f5bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f5c2 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789081506.139663:0:5786:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789081506.139666:0:5786:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9e10d1a03380 from 1 10000000:01000000:1.0:1789081506.139670:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789081506.139729:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10e13afc00/0xb7cb3d7479d5f5e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081506.139749:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e10e13afc00/0xb7cb3d7479d5f5e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081506.139765:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e10e13afc00/0xb7cb3d7479d5f5e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081506.139797:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101c33800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821243264:0@lo:101: 00000100:00100000:1.0:1789081506.139905:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081506.139972:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10f948ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1789081506.143611:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821243264 00000100:00100000:0.0:1789081506.143637:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821243264 00000100:00100000:0.0:1789081506.143728:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789081506.143741:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+15:5786:x1875987821243264:12345-0@lo:101: 00010000:00010000:0.0:1789081506.143768:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081506.143799:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10c0031000/0xb7cb3d7479d5f5ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f5e5 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081506.143838:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10c0031000/0xb7cb3d7479d5f5ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f5e5 expref: 16 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081506.143854:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10c0031000/0xb7cb3d7479d5f5ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f5e5 expref: 16 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081506.143865:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10c0031000, rc 0) 00000100:00100000:0.0:1789081506.143979:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:5786:x1875987821243264:12345-0@lo:101: Request processed in 240us (4073us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081506.143989:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789081506.144102:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101c33800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821243264:0@lo:101: 00010000:00010000:0.0:1789081506.144128:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e10e13afc00/0xb7cb3d7479d5f5e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f5ec expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081506.144141:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e10e13afc00/0xb7cb3d7479d5f5e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f5ec expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081506.144238:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821243392:0@lo:501: 00000100:00100000:0.0:1789081506.144277:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081506.144316:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d0c9e780 going to sleep for 11 seconds 00000100:00100000:0.0:1789081506.144332:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821243392 00000100:00100000:0.0:1789081506.144336:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821243392 00000100:00100000:0.0:1789081506.144360:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789081506.144367:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:5786:x1875987821243392:12345-0@lo:501: 00000100:00100000:0.0:1789081506.149505:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:5786:x1875987821243392:12345-0@lo:501: Request processed in 5126us (5215us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789081506.149558:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789081506.149627:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821243392:0@lo:501: 10000000:01000000:0.0:1789081506.149677:0:5786:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789081506.149689:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10e13afc00/0xb7cb3d7479d5f5e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f5ec expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081506.149703:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e10e13afc00/0xb7cb3d7479d5f5e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f5ec expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789081506.258123:0:5811:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:0.0:1789081506.351203:0:6651:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789081506.351244:0:6651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6651:1875987821243648:0@lo:7: 00000100:00100000:0.0:1789081506.351361:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081506.351597:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821243520:0@lo:13: 00000100:00100000:2.0:1789081506.351637:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081506.352649:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821243520 00000100:00100000:3.0:1789081506.352664:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821243520 00000100:00100000:3.0:1789081506.352750:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789081506.352761:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875987821243520:12345-0@lo:13: 00000100:00080000:1.0:1789081506.352790:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1789081506.352805:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1789081506.353983:0:6651:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c60c2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789081506.354308:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875987821243520:12345-0@lo:13: Request processed in 1543us (2663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081506.354321:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789081506.354361:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e11010b4380 x1875987821243520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081522 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081506.354389:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821243520:0@lo:13: 00000100:00100000:1.0:1789081506.354708:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821243648 00000100:00100000:1.0:1789081506.354720:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821243648 00000100:00100000:1.0:1789081506.354783:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789081506.354793:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:6651:x1875987821243648:12345-0@lo:7: 00002000:00080000:1.0:1789081506.369946:0:6584:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1789081506.369960:0:6584:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1789081506.370168:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6651:x1875987821243648:12345-0@lo:7: Request processed in 15370us (18799us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081506.370180:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789081506.370336:0:6651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e11010b4e00 x1875987821243648/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789081522 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081506.370432:0:6651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6651:1875987821243648:0@lo:7: 00000004:00080000:0.0:1789081506.372145:0:6651:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1789081506.372215:0:6651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6651:1875987821243776:0@lo:5: 00000100:00100000:0.0:1789081506.372301:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081506.372374:0:6651:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c60c2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789081506.372435:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821243776 00000100:00100000:2.0:1789081506.372444:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821243776 00000100:00100000:2.0:1789081506.372515:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789081506.372544:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6651:x1875987821243776:12345-0@lo:5: 00002000:00080000:2.0:1789081506.372585:0:6581:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789081506.372589:0:6581:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1789081506.372971:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6651:x1875987821243776:12345-0@lo:5: Request processed in 447us (669us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789081506.372980:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789081506.373009:0:6651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e11010b4e00 x1875987821243776/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789081522 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081506.373026:0:6651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6651:1875987821243776:0@lo:5: 00000004:00080000:0.0:1789081506.373037:0:6651:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789081506.373076:0:6651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6651:1875987821243904:0@lo:700: 00000100:00100000:0.0:1789081506.373107:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081506.373129:0:6651:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c60c2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789081506.373163:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821243904 00000100:00100000:3.0:1789081506.373169:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821243904 00000100:00100000:3.0:1789081506.373210:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789081506.373219:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6651:x1875987821243904:12345-0@lo:700: 00000100:00100000:3.0:1789081506.373313:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c50bad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6590:1875987821244032:0@lo:700: 00000100:00100000:3.0:1789081506.373349:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081506.373373:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0fc2a36c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789081506.373415:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821244032 00000100:00100000:0.0:1789081506.373421:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821244032 00000100:00100000:0.0:1789081506.373453:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789081506.373460:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6590:x1875987821244032:12345-0@lo:700: 40000000:02000000:0.0:1789081506.430472:0:5796:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1789081506.439151:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6590:x1875987821244032:12345-0@lo:700: Request processed in 65684us (65793us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081506.439170:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789081506.439238:0:6590:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e10c50bad80 x1875987821244032/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789081522 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081506.439256:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c50bad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6590:1875987821244032:0@lo:700: 40000000:02000000:0.0:1789081506.439274:0:6590:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00100000:1.0:1789081506.589044:0:6607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1789081506.589095:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:0.0:1789081506.589242:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6651:x1875987821243904:12345-0@lo:700: Request processed in 216004us (216113us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081506.589265:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789081506.589353:0:6651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e11010b4a80 x1875987821243904/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789081522 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081506.589367:0:6651:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789081506.589392:0:6651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6651:1875987821243904:0@lo:700: 00010000:00010000:1.0:1789081506.599810:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:02000040:0.0:1789081506.677808:0:6651:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1789081506.684638:0:6651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6651:1875987821244160:0@lo:5: 00000100:00100000:0.0:1789081506.684738:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081506.684818:0:6651:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c4c54240 going to sleep for 11 seconds 00000100:00100000:1.0:1789081506.685234:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821244160 00000100:00100000:1.0:1789081506.685247:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821244160 00000100:00100000:1.0:1789081506.685328:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789081506.685339:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6651:x1875987821244160:12345-0@lo:5: 00002000:00080000:0.0:1789081506.696420:0:6584:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1789081506.696447:0:6584:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1789081506.700892:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6651:x1875987821244160:12345-0@lo:5: Request processed in 15543us (16143us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789081506.700909:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789081506.701190:0:6651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e11010b4a80 x1875987821244160/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789081522 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789081506.701232:0:6651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6651:1875987821244160:0@lo:5: 00000004:00080000:1.0:1789081506.701252:0:6651:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1789081507.622763:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081508.653365:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081509.667494:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081510.686605:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081511.261231:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c50bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875987821244416:0@lo:400: 00000100:00100000:3.0:1789081511.261334:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081511.261412:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789081511.261418:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c50b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875987821244544:0@lo:400: 00000100:00100000:3.0:1789081511.261443:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081511.261484:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821244416 00000100:00100000:3.0:1789081511.261492:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821244416 00000100:00100000:3.0:1789081511.261560:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821244544 00000100:00100000:3.0:1789081511.261564:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821244544 00000100:00100000:3.0:1789081511.261596:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789081511.261604:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875987821244416:12345-0@lo:400: 00000100:00100000:3.0:1789081511.261659:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875987821244416:12345-0@lo:400: Request processed in 54us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081511.261667:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789081511.261688:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789081511.261694:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875987821244544:12345-0@lo:400: 00000100:00100000:3.0:1789081511.261723:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875987821244544:12345-0@lo:400: Request processed in 29us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081511.261729:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1789081511.261751:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789081511.261782:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e10c50b8000 x1875987821244544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789081527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789081511.261797:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c50b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875987821244544:0@lo:400: 00010000:00080000:3.0:1789081511.261809:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e10c50bad80 x1875987821244416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789081527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789081511.261817:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c50bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875987821244416:0@lo:400: 00000100:00100000:2.0:1789081511.262050:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c50b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821244672:0@lo:400: 00000100:00100000:2.0:1789081511.262093:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081511.262124:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789081511.262131:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c50b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee551687-7675-4fc6-9be1-2ccb62bdd809:3303:1875987821244288:0@lo:400: 00000100:00100000:2.0:1789081511.262162:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081511.262325:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821244672 00000100:00100000:3.0:1789081511.262331:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821244672 00000100:00100000:3.0:1789081511.262375:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789081511.262382:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9485c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1875987821244672:12345-0@lo:400: 00000100:00100000:3.0:1789081511.262426:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9485c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1875987821244672:12345-0@lo:400: Request processed in 43us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081511.262433:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789081511.262460:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e10c50b8a80 x1875987821244672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789081527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789081511.262472:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c50b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821244672:0@lo:400: 00000100:00100000:0.0:1789081511.262571:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821244288 00000100:00100000:0.0:1789081511.262576:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821244288 00000100:00100000:0.0:1789081511.262624:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789081511.262639:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:3303:x1875987821244288:12345-0@lo:400: 00000100:00100000:0.0:1789081511.262687:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:3303:x1875987821244288:12345-0@lo:400: Request processed in 48us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081511.262693:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789081511.262741:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c50b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee551687-7675-4fc6-9be1-2ccb62bdd809:3303:1875987821244288:0@lo:400: 00000100:00080000:2.0:1789081511.262844:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789081511.712302:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081511.781013:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789081511.781047:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c50b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821244800:0@lo:13: 00000100:00100000:3.0:1789081511.781139:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081511.781234:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821244800 00000100:00100000:3.0:1789081511.781243:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821244800 00000100:00100000:3.0:1789081511.781301:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789081511.781311:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875987821244800:12345-0@lo:13: 00002000:00000024:3.0:1789081511.781360:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789081511.781412:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875987821244800:12345-0@lo:13: Request processed in 102us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081511.781421:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789081511.781470:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e10c50b8a80 x1875987821244800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081527 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789081511.781493:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c50b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821244800:0@lo:13: 00000001:00080000:1.0:1789081511.916595:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1789081512.733347:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789081512.953289:0:6952:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg117-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789081513.757114:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081514.780716:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081515.804856:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081516.381088:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101c31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821244928:0@lo:400: 00000100:00100000:3.0:1789081516.381250:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081516.381339:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789081516.381346:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101c30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875987821245056:0@lo:400: 00000100:00100000:3.0:1789081516.381379:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081516.381421:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821245056 00000100:00100000:3.0:1789081516.381430:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821245056 00000100:00100000:3.0:1789081516.381487:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789081516.381496:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875987821245056:12345-0@lo:400: 00000100:00100000:3.0:1789081516.381576:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875987821245056:12345-0@lo:400: Request processed in 80us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081516.381583:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789081516.381633:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e1101c30380 x1875987821245056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789081532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789081516.381661:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101c30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875987821245056:0@lo:400: 00000100:00100000:1.0:1789081516.382043:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821244928 00000100:00100000:1.0:1789081516.382050:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821244928 00000100:00100000:1.0:1789081516.382088:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789081516.382094:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:3305:x1875987821244928:12345-0@lo:400: 00000100:00100000:1.0:1789081516.382152:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:3305:x1875987821244928:12345-0@lo:400: Request processed in 58us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081516.382159:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789081516.382327:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875987821245184:0@lo:400: 00000100:00100000:2.0:1789081516.382385:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081516.382412:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789081516.382417:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101c31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821245312:0@lo:400: 00000100:00100000:2.0:1789081516.382445:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081516.382572:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821245184 00000100:00100000:0.0:1789081516.382578:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821245184 00000100:00100000:0.0:1789081516.382619:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789081516.382627:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875987821245184:12345-0@lo:400: 00000100:00100000:0.0:1789081516.382846:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875987821245184:12345-0@lo:400: Request processed in 58us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081516.382853:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789081516.382958:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101c31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821244928:0@lo:400: 00000100:00080000:2.0:1789081516.383022:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789081516.383051:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e1101c33800 x1875987821245184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789081532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789081516.383062:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875987821245184:0@lo:400: 00000100:00100000:1.0:1789081516.383311:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821245312 00000100:00100000:1.0:1789081516.383318:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821245312 00000100:00100000:1.0:1789081516.383371:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789081516.383379:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821245312:12345-0@lo:400: 00000100:00100000:1.0:1789081516.383439:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821245312:12345-0@lo:400: Request processed in 61us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081516.383445:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789081516.383562:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e1101c31180 x1875987821245312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789081532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081516.383571:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789081516.383586:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101c31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821245312:0@lo:400: 00000100:00080000:2.0:1789081516.383641:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789081516.828816:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789081516.900162:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789081516.900196:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821245440:0@lo:13: 00000100:00100000:0.0:1789081516.900289:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081516.900380:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821245440 00000100:00100000:0.0:1789081516.900389:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821245440 00000100:00100000:0.0:1789081516.900443:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789081516.900451:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821245440:12345-0@lo:13: 00002000:00000024:0.0:1789081516.901126:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789081516.901208:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821245440:12345-0@lo:13: Request processed in 756us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081516.901217:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789081516.901914:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e10f9486d80 x1875987821245440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081532 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789081516.901939:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821245440:0@lo:13: 00010000:00010000:0.0:1789081517.853132:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081518.896256:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081519.906258:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081520.924712:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789081521.511638:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875987821245824:0@lo:400: 00000100:00100000:2.0:1789081521.511734:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081521.511824:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789081521.511830:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875987821245696:0@lo:400: 00000100:00100000:2.0:1789081521.511858:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081521.513803:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821245568:0@lo:400: 00000100:00100000:1.0:1789081521.513807:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821245952:0@lo:400: 00000100:00100000:2.0:1789081521.513971:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821245824 00000100:00100000:2.0:1789081521.513981:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821245824 00000100:00100000:2.0:1789081521.514051:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821245696 00000100:00100000:2.0:1789081521.514056:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821245696 00000100:00100000:2.0:1789081521.514077:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789081521.514086:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875987821245824:12345-0@lo:400: 00000100:00100000:0.0:1789081521.517491:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789081521.517515:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789081521.517585:0:5790:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789081521.517616:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789081521.517633:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875987821245696:12345-0@lo:400: 00000100:00100000:3.0:1789081521.518698:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081521.518784:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821245568 00000100:00100000:3.0:1789081521.518803:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821245568 00000100:00100000:3.0:1789081521.518854:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789081521.518865:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:3306:x1875987821245568:12345-0@lo:400: 00000100:00100000:3.0:1789081521.519194:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:3306:x1875987821245568:12345-0@lo:400: Request processed in 330us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081521.519202:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789081521.519275:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821245568:0@lo:400: 00000100:00080000:3.0:1789081521.519519:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789081521.527994:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875987821245824:12345-0@lo:400: Request processed in 13893us (16243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081521.528014:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1789081521.528122:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e10f9486680 x1875987821245824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789081537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789081521.528145:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875987821245824:0@lo:400: 00000100:00100000:1.0:1789081521.538117:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081521.538232:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821245952 00000100:00100000:1.0:1789081521.538243:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821245952 00000100:00100000:1.0:1789081521.538307:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789081521.538320:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821245952:12345-0@lo:400: 00000100:00100000:1.0:1789081521.538391:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821245952:12345-0@lo:400: Request processed in 74us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081521.538409:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789081521.538435:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789081521.538475:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e10f9485180 x1875987821245952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789081537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789081521.538491:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821245952:0@lo:400: 00000100:00100000:0.0:1789081521.547631:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875987821245696:12345-0@lo:400: Request processed in 29775us (35542us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081521.547650:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1789081521.548685:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e10f9485f80 x1875987821245696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789081537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789081521.548713:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875987821245696:0@lo:400: 00010000:00010000:3.0:1789081521.950901:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789081522.013731:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821246080:0@lo:13: 00000100:00100000:2.0:1789081522.013841:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081522.013958:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821246080 00000100:00100000:2.0:1789081522.013967:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821246080 00000100:00100000:2.0:1789081522.014237:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789081522.014247:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821246080:12345-0@lo:13: 00002000:00000024:2.0:1789081522.014287:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789081522.014336:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821246080:12345-0@lo:13: Request processed in 91us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081522.014344:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789081522.014391:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e10f9485f80 x1875987821246080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081538 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789081522.014412:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821246080:0@lo:13: 00010000:00010000:1.0:1789081522.973970:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081524.010946:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081525.020806:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789081525.254058:0:7475:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789081525.254064:0:7475:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1789081525.254228:0:7475:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9e10ff7e6800 00000020:01000004:2.0:1789081525.254246:0:7475:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789081525.254261:0:7475:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1789081525.254278:0:7475:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9e10ff7d3380) 00000020:00000080:2.0:1789081525.254298:0:7475:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789081525.269826:0:7475:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789081525.270201:0:7475:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789081525.291090:0:7475:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789081525.304987:0:7475:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789081525.305029:0:7475:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789081525.305092:0:7475:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789081525.305120:0:7475:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789081525.305564:0:7475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789081525.305583:0:7475:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789081525.305596:0:7475:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb7cb3d7479d5f5fa 00000020:01000004:2.0:1789081525.305606:0:7475:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789081525.305636:0:7475:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.117@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789081525.305639:0:7475:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.117@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789081525.305647:0:7475:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789081525.305674:0:7475:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789081525.305679:0:7475:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.117@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789081525.363012:0:7475:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.117@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789081525.363066:0:7475:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.117@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1789081525.363070:0:7475:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789081525.363072:0:7475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789081525.363073:0:7475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789081525.363074:0:7475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789081525.363075:0:7475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789081525.363077:0:7475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789081525.363078:0:7475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789081525.363080:0:7475:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789081525.363081:0:7475:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789081525.363082:0:7475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789081525.363084:0:7475:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789081525.363088:0:7475:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1789081525.363090:0:7475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789081525.363092:0:7475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789081525.363093:0:7475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789081525.363094:0:7475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789081525.363095:0:7475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789081525.363096:0:7475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789081525.363098:0:7475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789081525.363099:0:7475:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789081525.363100:0:7475:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789081525.363101:0:7475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789081525.363102:0:7475:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789081525.363129:0:7475:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789081525.363149:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9485f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:7475:1875987821246208:0@lo:253: 00000100:00100000:2.0:1789081525.363244:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081525.364181:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e1101986f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789081525.364311:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821246208 00000100:00100000:0.0:1789081525.364323:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821246208 00000100:00100000:0.0:1789081525.364431:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789081525.364442:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:7475:x1875987821246208:12345-0@lo:253: 20000000:01000000:0.0:1789081525.364480:0:5784:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789081525.364485:0:5784:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1789081525.364491:0:5784:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1789081525.364495:0:5784:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1789081525.371363:0:5784:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789081525.371649:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1789081525.371667:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1789081525.371713:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1789081525.371735:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1789081525.371770:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1789081525.371822:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1789081525.372236:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1789081525.372270:0:5784:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.117@tcp 20000000:01000000:0.0:1789081525.372272:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.117@tcp (null) (null) (null) 00000040:00080000:0.0:1789081525.372311:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1789081525.372319:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789081525.372366:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1789081525.372374:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.117@tcp (null) (null) 00000040:00080000:0.0:1789081525.372407:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1789081525.372417:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789081525.372447:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1789081525.372513:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1789081525.375259:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1789081525.375310:0:5784:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.117@tcp 20000000:01000000:0.0:1789081525.375314:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.117@tcp (null) (null) (null) 00000040:00080000:0.0:1789081525.375366:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1789081525.375376:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789081525.375408:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1789081525.375415:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.117@tcp (null) (null) 00000040:00080000:0.0:1789081525.375444:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1789081525.375456:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789081525.375506:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1789081525.376275:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1789081525.376310:0:5784:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1789081525.376314:0:5784:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1789081525.376321:0:5784:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789081525.376323:0:5784:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789081525.376325:0:5784:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789081525.376343:0:5784:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789081525.376346:0:5784:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789081525.376398:0:5784:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789081525.376401:0:5784:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789081525.384927:0:7477:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1789081525.385355:0:7477:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1789081525.385433:0:7477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1789081525.385958:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1789081525.386021:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1789081525.386094:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1789081525.386109:0:5784:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789081525.386112:0:5784:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789081525.386991:0:7478:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1789081525.387072:0:7478:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1789081525.387124:0:7478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1789081525.387588:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1789081525.387630:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1789081525.387663:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1789081525.387678:0:5784:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789081525.387680:0:5784:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789081525.393333:0:7479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1789081525.394849:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1789081525.394957:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1789081525.395065:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1789081525.395085:0:5784:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789081525.395089:0:5784:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789081525.396965:0:7480:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1789081525.397114:0:7480:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1789081525.397187:0:7480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1789081525.397848:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1789081525.397902:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1789081525.397989:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:0.0:1789081525.398199:0:5784:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789081525.398225:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e10c0030000/0xb7cb3d7479d5f601 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081525.398246:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e1102044000/0xb7cb3d7479d5f552 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f54b expref: 16 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081525.398255:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e1102044800/0xb7cb3d7479d5f57c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f575 expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081525.398263:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e10e13af200/0xb7cb3d7479d5f5a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f59f expref: 16 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081525.398271:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e10c29e1600/0xb7cb3d7479d5f5c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f5bb expref: 16 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081525.398278:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e10c0031000/0xb7cb3d7479d5f5ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f5e5 expref: 16 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081525.398286:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e10c0030000/0xb7cb3d7479d5f601 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081525.398328:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e10c0031000/0xb7cb3d7479d5f5ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb7cb3d7479d5f5e5 expref: 16 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081525.398346:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e10c0031000/0xb7cb3d7479d5f5ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f5e5 expref: 16 pid: 5782 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081525.398371:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b5500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5784:1875987821246336:0@lo:104: 00000100:00100000:0.0:1789081525.398446:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789081525.398512:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e10c29e1600/0xb7cb3d7479d5f5c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb7cb3d7479d5f5bb expref: 16 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081525.398568:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e10c29e1600/0xb7cb3d7479d5f5c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f5bb expref: 16 pid: 5782 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081525.398579:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b6d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5784:1875987821246464:0@lo:104: 00000100:00100000:0.0:1789081525.398603:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789081525.398632:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e10e13af200/0xb7cb3d7479d5f5a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb7cb3d7479d5f59f expref: 16 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081525.398641:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e10e13af200/0xb7cb3d7479d5f5a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f59f expref: 16 pid: 5783 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081525.398650:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5784:1875987821246592:0@lo:104: 00000100:00100000:0.0:1789081525.398686:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789081525.398706:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e1102044800/0xb7cb3d7479d5f57c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb7cb3d7479d5f575 expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081525.398714:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e1102044800/0xb7cb3d7479d5f57c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f575 expref: 16 pid: 5784 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081525.398735:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b5180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5784:1875987821246720:0@lo:104: 00000100:00100000:0.0:1789081525.398757:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789081525.398773:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e1102044000/0xb7cb3d7479d5f552 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb7cb3d7479d5f54b expref: 16 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081525.398793:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e1102044000/0xb7cb3d7479d5f552 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f54b expref: 16 pid: 5783 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081525.398802:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5784:1875987821246848:0@lo:104: 00000100:00100000:0.0:1789081525.398825:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081525.398835:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c539f240 going to sleep for 11 seconds 00000100:00100000:3.0:1789081525.399088:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821246336 00000100:00100000:3.0:1789081525.399096:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821246336 00000100:00100000:3.0:1789081525.399138:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821246464 00000100:00100000:3.0:1789081525.399142:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821246464 00000100:00100000:3.0:1789081525.399153:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821246592 00000100:00100000:3.0:1789081525.399156:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821246592 00000100:00100000:3.0:1789081525.399164:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821246720 00000100:00100000:3.0:1789081525.399166:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821246720 00000100:00100000:3.0:1789081525.399190:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821246848 00000100:00100000:3.0:1789081525.399193:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821246848 00000100:00100000:3.0:1789081525.399206:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789081525.399214:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+7:5784:x1875987821246336:12345-0@lo:104: 00010000:00010000:3.0:1789081525.399227:0:5772:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.117@tcp lock: ffff9e10e13afc00/0xb7cb3d7479d5f5e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f5ec expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.399304:0:5772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789081525.399311:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+7:5784:x1875987821246336:12345-0@lo:104: Request processed in 97us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081525.399318:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789081525.399340:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789081525.399346:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+6:5784:x1875987821246464:12345-0@lo:104: 00010000:00010000:3.0:1789081525.399353:0:5772:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.117@tcp lock: ffff9e1102045000/0xb7cb3d7479d5f5bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f5c2 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.399389:0:5772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789081525.399400:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+6:5784:x1875987821246464:12345-0@lo:104: Request processed in 54us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081525.399406:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789081525.399420:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789081525.399426:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+5:5784:x1875987821246592:12345-0@lo:104: 00010000:00010000:3.0:1789081525.399433:0:5772:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0e00/0xb7cb3d7479d5f59f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f5a6 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.399461:0:5772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789081525.399465:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+5:5784:x1875987821246592:12345-0@lo:104: Request processed in 40us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081525.399470:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789081525.399482:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789081525.399487:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+4:5784:x1875987821246720:12345-0@lo:104: 00010000:00010000:3.0:1789081525.399494:0:5772:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.117@tcp lock: ffff9e10e13af400/0xb7cb3d7479d5f575 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f57c expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.399561:0:5772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789081525.399566:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+4:5784:x1875987821246720:12345-0@lo:104: Request processed in 80us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081525.399571:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789081525.399583:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789081525.399588:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+3:5784:x1875987821246848:12345-0@lo:104: 00010000:00010000:3.0:1789081525.399595:0:5772:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.117@tcp lock: ffff9e10c0030a00/0xb7cb3d7479d5f54b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f552 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.399620:0:5772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1789081525.399631:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+3:5784:x1875987821246848:12345-0@lo:104: Request processed in 43us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081525.399636:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1789081525.399657:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1789081525.399663:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e10e13afc00/0xb7cb3d7479d5f5e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f5ec expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.399669:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13afc00 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:3.0:1789081525.399675:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e10e13afc00/0xb7cb3d7479d5f5e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb7cb3d7479d5f5ec expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.399683:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e10e13afc00/0xb7cb3d7479d5f5e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb7cb3d7479d5f5ec expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789081525.399689:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e10e13afc00/0xb7cb3d7479d5f5e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb7cb3d7479d5f5ec expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789081525.399694:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789081525.399739:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e10e13afc00/0xb7cb3d7479d5f5e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f5ec expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.399746:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789081525.399763:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e10e13afc00/0xb7cb3d7479d5f5e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f5ec expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.399770:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e10e13afc00/0xb7cb3d7479d5f5e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f5ec expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.399785:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789081525.399788:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e1102045000/0xb7cb3d7479d5f5bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f5c2 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.399805:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1102045000 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:3.0:1789081525.399808:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e1102045000/0xb7cb3d7479d5f5bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb7cb3d7479d5f5c2 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.399813:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e1102045000/0xb7cb3d7479d5f5bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb7cb3d7479d5f5c2 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789081525.399819:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e1102045000/0xb7cb3d7479d5f5bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb7cb3d7479d5f5c2 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789081525.399824:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789081525.399838:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e1102045000/0xb7cb3d7479d5f5bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f5c2 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.399844:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789081525.399849:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e1102045000/0xb7cb3d7479d5f5bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f5c2 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.399855:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e1102045000/0xb7cb3d7479d5f5bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f5c2 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.399866:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789081525.399869:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0e00/0xb7cb3d7479d5f59f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f5a6 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.399874:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10c29e0e00 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:3.0:1789081525.399877:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0e00/0xb7cb3d7479d5f59f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb7cb3d7479d5f5a6 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.399896:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0e00/0xb7cb3d7479d5f59f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb7cb3d7479d5f5a6 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789081525.399902:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0e00/0xb7cb3d7479d5f59f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb7cb3d7479d5f5a6 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789081525.399907:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789081525.400188:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0e00/0xb7cb3d7479d5f59f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f5a6 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.400195:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789081525.400209:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0e00/0xb7cb3d7479d5f59f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f5a6 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.400215:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0e00/0xb7cb3d7479d5f59f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f5a6 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.400228:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789081525.400231:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e10e13af400/0xb7cb3d7479d5f575 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f57c expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.400236:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13af400 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:3.0:1789081525.400239:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e10e13af400/0xb7cb3d7479d5f575 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb7cb3d7479d5f57c expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.400245:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e10e13af400/0xb7cb3d7479d5f575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb7cb3d7479d5f57c expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789081525.400251:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e10e13af400/0xb7cb3d7479d5f575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb7cb3d7479d5f57c expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789081525.400262:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789081525.400276:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e10e13af400/0xb7cb3d7479d5f575 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f57c expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.400281:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789081525.400287:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e10e13af400/0xb7cb3d7479d5f575 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f57c expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.400293:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e10e13af400/0xb7cb3d7479d5f575 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f57c expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.400302:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789081525.400304:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e10c0030a00/0xb7cb3d7479d5f54b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f552 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.400309:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10c0030a00 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:3.0:1789081525.400312:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e10c0030a00/0xb7cb3d7479d5f54b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb7cb3d7479d5f552 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.400319:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e10c0030a00/0xb7cb3d7479d5f54b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb7cb3d7479d5f552 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789081525.400324:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e10c0030a00/0xb7cb3d7479d5f54b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb7cb3d7479d5f552 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789081525.400330:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789081525.400341:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e10c0030a00/0xb7cb3d7479d5f54b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f552 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.400346:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789081525.400356:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e10c0030a00/0xb7cb3d7479d5f54b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f552 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.400362:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e10c0030a00/0xb7cb3d7479d5f54b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f552 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.400390:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081525.400392:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081525.400394:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081525.400405:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789081525.400562:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c50b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821247104:0@lo:103: 00000100:00100000:2.0:1789081525.400623:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081525.400677:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789081525.400684:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c50b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821246976:0@lo:103: 00000100:00100000:2.0:1789081525.400706:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081525.400738:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c50b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821247488:0@lo:103: 00000100:00100000:2.0:1789081525.400757:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081525.400783:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c50b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821247232:0@lo:103: 00000100:00100000:2.0:1789081525.400806:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081525.400818:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789081525.400823:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c50baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821247360:0@lo:103: 00000100:00100000:2.0:1789081525.400843:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081525.400874:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821247104 00000100:00100000:2.0:1789081525.400882:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821247104 00010000:00010000:2.0:1789081525.400911:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e10c29e1600/0xb7cb3d7479d5f5c2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f5bb expref: 17 pid: 5782 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081525.400946:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821246976 00000100:00100000:2.0:1789081525.400956:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821246976 00010000:00010000:2.0:1789081525.400971:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e10c0031000/0xb7cb3d7479d5f5ec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f5e5 expref: 18 pid: 5782 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081525.400982:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821247488 00000100:00100000:2.0:1789081525.400985:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821247488 00010000:00010000:2.0:1789081525.400994:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e1102044000/0xb7cb3d7479d5f552 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f54b expref: 19 pid: 5783 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081525.401423:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821247232 00000100:00100000:2.0:1789081525.401429:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821247232 00010000:00010000:2.0:1789081525.401462:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e10e13af200/0xb7cb3d7479d5f5a6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f59f expref: 20 pid: 5783 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081525.401475:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821247360 00000100:00100000:2.0:1789081525.401478:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821247360 00010000:00010000:2.0:1789081525.401488:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e1102044800/0xb7cb3d7479d5f57c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f575 expref: 21 pid: 5784 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081525.401501:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789081525.401508:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9485880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee551687-7675-4fc6-9be1-2ccb62bdd809+21:3304:x1875987821247104:12345-0@lo:103: 00010000:00010000:2.0:1789081525.401566:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789081525.401573:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e10c29e1600/0xb7cb3d7479d5f5c2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f5bb expref: 21 pid: 5782 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081525.401583:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e10c29e1600/0xb7cb3d7479d5f5c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f5bb expref: 21 pid: 5782 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081525.401605:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789081525.401661:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9485880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee551687-7675-4fc6-9be1-2ccb62bdd809+21:3304:x1875987821247104:12345-0@lo:103: Request processed in 153us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081525.401667:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789081525.401698:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789081525.401704:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9484380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee551687-7675-4fc6-9be1-2ccb62bdd809+20:3304:x1875987821246976:12345-0@lo:103: 00010000:00010000:2.0:1789081525.401712:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789081525.401717:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e10c0031000/0xb7cb3d7479d5f5ec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f5e5 expref: 20 pid: 5782 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081525.401738:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e10c0031000/0xb7cb3d7479d5f5ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f5e5 expref: 20 pid: 5782 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081525.401748:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789081525.401773:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9484380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee551687-7675-4fc6-9be1-2ccb62bdd809+20:3304:x1875987821246976:12345-0@lo:103: Request processed in 69us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081525.401778:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789081525.401790:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789081525.401795:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9484e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3304:x1875987821247488:12345-0@lo:103: 00010000:00010000:2.0:1789081525.401802:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789081525.401805:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e1102044000/0xb7cb3d7479d5f552 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f54b expref: 19 pid: 5783 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081525.401813:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e1102044000/0xb7cb3d7479d5f552 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f54b expref: 19 pid: 5783 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081525.401823:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789081525.401843:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9484e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3304:x1875987821247488:12345-0@lo:103: Request processed in 49us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081525.401848:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789081525.401861:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789081525.401867:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9485180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:3305:x1875987821247232:12345-0@lo:103: 00010000:00010000:2.0:1789081525.401874:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789081525.401884:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e10e13af200/0xb7cb3d7479d5f5a6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f59f expref: 18 pid: 5783 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081525.401892:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e10e13af200/0xb7cb3d7479d5f5a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f59f expref: 18 pid: 5783 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081525.401904:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789081525.402201:0:5775:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789081525.402213:0:5775:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1789081525.402295:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9485180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:3305:x1875987821247232:12345-0@lo:103: Request processed in 428us (1488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081525.402303:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789081525.402321:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789081525.402328:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9486d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:3305:x1875987821247360:12345-0@lo:103: 00010000:00010000:2.0:1789081525.402336:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789081525.402341:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e1102044800/0xb7cb3d7479d5f57c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f575 expref: 17 pid: 5784 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081525.402349:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e1102044800/0xb7cb3d7479d5f57c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f575 expref: 17 pid: 5784 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081525.402364:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e10c0030000/0xb7cb3d7479d5f601 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081525.402373:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10c0030000/0xb7cb3d7479d5f601 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081525.402387:0:5776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e10c0030000/0xb7cb3d7479d5f601 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081525.402395:0:5776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e10c0030000/0xb7cb3d7479d5f601 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081525.402403:0:5776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e10c0030000/0xb7cb3d7479d5f601 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081525.402416:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e10c0030000/0xb7cb3d7479d5f601 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081525.402423:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10c0030000 already unused, calling callback (ffffffffc1784220) 00010000:00010000:2.0:1789081525.402428:0:5776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e10c0030000/0xb7cb3d7479d5f601 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081525.402436:0:5776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e10c0030000/0xb7cb3d7479d5f601 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081525.402445:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e10c0030000/0xb7cb3d7479d5f601 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081525.402455:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789081525.402484:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9486d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:3305:x1875987821247360:12345-0@lo:103: Request processed in 157us (1639us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081525.402489:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789081525.403331:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c50b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821246976:0@lo:103: 00000100:00100000:0.0:1789081525.403347:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c50b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821247488:0@lo:103: 00000100:00100000:0.0:1789081525.403356:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c50b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821247104:0@lo:103: 00000100:00100000:3.0:1789081525.403679:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c50baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821247360:0@lo:103: 00000100:00100000:3.0:1789081525.403690:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c50b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821247232:0@lo:103: 00010000:00010000:0.0:1789081525.404288:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10c0031000/0xb7cb3d7479d5f5ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb7cb3d7479d5f5e5 expref: 16 pid: 5782 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081525.404307:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b5500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5784:1875987821246336:0@lo:104: 00010000:00010000:0.0:1789081525.404321:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10c29e1600/0xb7cb3d7479d5f5c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb7cb3d7479d5f5bb expref: 15 pid: 5782 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081525.404331:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b6d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5784:1875987821246464:0@lo:104: 00010000:00010000:0.0:1789081525.404343:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10e13af200/0xb7cb3d7479d5f5a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb7cb3d7479d5f59f expref: 14 pid: 5783 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081525.404352:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5784:1875987821246592:0@lo:104: 00010000:00010000:0.0:1789081525.404363:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e1102044800/0xb7cb3d7479d5f57c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb7cb3d7479d5f575 expref: 13 pid: 5784 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081525.404373:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b5180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5784:1875987821246720:0@lo:104: 00010000:00010000:0.0:1789081525.404394:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e1102044000/0xb7cb3d7479d5f552 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb7cb3d7479d5f54b expref: 12 pid: 5783 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081525.404404:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5784:1875987821246848:0@lo:104: 00010000:00010000:0.0:1789081525.404430:0:5784:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e10c0030000/0xb7cb3d7479d5f601 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081525.404439:0:5784:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e10c0030000/0xb7cb3d7479d5f601 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081525.404445:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e10c0030000/0xb7cb3d7479d5f601 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081525.404450:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10c0030000/0xb7cb3d7479d5f601 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789081525.404469:0:5784:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789081525.514499:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+11:7475:x1875987821246208:12345-0@lo:253: Request processed in 150045us (151239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081525.514544:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789081525.514556:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9485f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:7475:1875987821246208:0@lo:253: 10000000:01000000:1.0:1789081525.514573:0:7475:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789081525.514577:0:7475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789081525.514578:0:7475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789081525.514580:0:7475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789081525.514581:0:7475:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1789081525.514582:0:7475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789081525.514584:0:7475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789081525.514585:0:7475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789081525.514587:0:7475:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789081525.514589:0:7475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789081525.514590:0:7475:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789081525.514613:0:7475:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e10ff7e6800 from lustre-OST0001 10000000:01000000:1.0:1789081525.514652:0:7475:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789081525.514657:0:7475:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789081525.514684:0:7475:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e10d1a03380 local copy 10000000:01000000:1.0:1789081525.514689:0:7475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789081525.514740:0:7475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10e13aea00/0xb7cb3d7479d5f608 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081525.514753:0:7475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.117@tcp lock: ffff9e10e13aea00/0xb7cb3d7479d5f608 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081525.514768:0:7475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e10e13aea00/0xb7cb3d7479d5f608 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081525.514788:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101c31c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:7475:1875987821247616:0@lo:101: 00000100:00100000:1.0:1789081525.514827:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081525.514909:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c8e870c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789081525.514988:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821247616 00000100:00100000:3.0:1789081525.514995:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821247616 00000100:00100000:3.0:1789081525.515056:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789081525.515066:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+11:7475:x1875987821247616:12345-0@lo:101: 00010000:00010000:3.0:1789081525.515081:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081525.515098:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e1101998600/0xb7cb3d7479d5f60f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f608 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.515123:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e1101998600/0xb7cb3d7479d5f60f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f608 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.515134:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e1101998600/0xb7cb3d7479d5f60f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f608 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.515143:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101998600, rc 0) 00000100:00100000:3.0:1789081525.515196:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:7475:x1875987821247616:12345-0@lo:101: Request processed in 131us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081525.515203:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789081525.515378:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101c31c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:7475:1875987821247616:0@lo:101: 00010000:00010000:1.0:1789081525.515393:0:7475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e10e13aea00/0xb7cb3d7479d5f608 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xb7cb3d7479d5f60f expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081525.515412:0:7475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e10e13aea00/0xb7cb3d7479d5f608 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb7cb3d7479d5f60f expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081525.515571:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101c31c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:7475:1875987821247744:0@lo:501: 00000100:00100000:1.0:1789081525.515621:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081525.515650:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c8e870c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789081525.515660:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821247744 00000100:00100000:2.0:1789081525.515665:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821247744 00000100:00100000:2.0:1789081525.515747:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789081525.515755:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:7475:x1875987821247744:12345-0@lo:501: 00000100:00100000:2.0:1789081525.516008:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:7475:x1875987821247744:12345-0@lo:501: Request processed in 254us (386us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789081525.516016:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789081525.516125:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101c31c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:7475:1875987821247744:0@lo:501: 10000000:01000000:1.0:1789081525.516139:0:7475:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.117@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789081525.516170:0:7475:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.117@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789081525.516175:0:7475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10e13aea00/0xb7cb3d7479d5f608 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb7cb3d7479d5f60f expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081525.516191:0:7475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10e13aea00/0xb7cb3d7479d5f608 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb7cb3d7479d5f60f expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081525.516198:0:7475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.117@tcp lock: ffff9e10e13aea00/0xb7cb3d7479d5f608 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb7cb3d7479d5f60f expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081525.516226:0:7475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789081525.516261:0:7475:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e10ff7e6800 10000000:01000000:1.0:1789081525.516266:0:7475:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789081525.516272:0:7475:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789081525.516274:0:7475:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789081525.516278:0:7475:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789081525.516282:0:7475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789081525.516302:0:7475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10e13af200/0xb7cb3d7479d5f616 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081525.516310:0:7475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e10e13af200/0xb7cb3d7479d5f616 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081525.516318:0:7475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e10e13af200/0xb7cb3d7479d5f616 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081525.516333:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101c31c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:7475:1875987821247872:0@lo:101: 00000100:00100000:1.0:1789081525.516364:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789081525.517192:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789081525.517201:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e10e13aea00/0xb7cb3d7479d5f608 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xb7cb3d7479d5f60f expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.517211:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13aea00 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:3.0:1789081525.517215:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e10e13aea00/0xb7cb3d7479d5f608 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xb7cb3d7479d5f60f expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.517225:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e10e13aea00/0xb7cb3d7479d5f608 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xb7cb3d7479d5f60f expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789081525.517232:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e10e13aea00/0xb7cb3d7479d5f608 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xb7cb3d7479d5f60f expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789081525.517238:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789081525.517268:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e10e13aea00/0xb7cb3d7479d5f608 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb7cb3d7479d5f60f expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.517274:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789081525.517303:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e10e13aea00/0xb7cb3d7479d5f608 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb7cb3d7479d5f60f expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.517310:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e10e13aea00/0xb7cb3d7479d5f608 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb7cb3d7479d5f60f expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.517327:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081525.517329:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081525.517330:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081525.517361:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c50b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821248000:0@lo:103: 00000100:00100000:3.0:1789081525.517600:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081525.517696:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821248000 00000100:00100000:3.0:1789081525.517705:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821248000 00000100:00100000:3.0:1789081525.517772:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789081525.517782:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:3304:x1875987821248000:12345-0@lo:103: 00010000:00010000:3.0:1789081525.517796:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081525.517812:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e1101998600/0xb7cb3d7479d5f60f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb7cb3d7479d5f608 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.517831:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789081525.517867:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee551687-7675-4fc6-9be1-2ccb62bdd809+11:3304:x1875987821248000:12345-0@lo:103: Request processed in 86us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081525.517874:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789081525.517913:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c50b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821248000:0@lo:103: 00000100:00100000:1.0:1789081525.520266:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c8e87780 going to sleep for 11 seconds 00000100:00100000:0.0:1789081525.522097:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821247872 00000100:00100000:0.0:1789081525.522114:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821247872 00000100:00100000:0.0:1789081525.522186:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789081525.522196:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+11:7475:x1875987821247872:12345-0@lo:101: 00010000:00010000:0.0:1789081525.522213:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081525.522235:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10c0030000/0xb7cb3d7479d5f61d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f616 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081525.522264:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10c0030000/0xb7cb3d7479d5f61d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f616 expref: 12 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081525.522275:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10c0030000/0xb7cb3d7479d5f61d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f616 expref: 12 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081525.522304:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10c0030000, rc 0) 00000100:00100000:0.0:1789081525.522591:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:7475:x1875987821247872:12345-0@lo:101: Request processed in 395us (6224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081525.522598:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789081525.525703:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101c31c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:7475:1875987821247872:0@lo:101: 00010000:00010000:1.0:1789081525.525888:0:7475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e10e13af200/0xb7cb3d7479d5f616 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f61d expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081525.525932:0:7475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e10e13af200/0xb7cb3d7479d5f616 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f61d expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081525.531299:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:7475:1875987821248128:0@lo:501: 00000100:00100000:0.0:1789081525.531750:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081525.531823:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c539fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789081525.532051:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821248128 00000100:00100000:3.0:1789081525.532060:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821248128 00000100:00100000:3.0:1789081525.532127:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789081525.532137:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:7475:x1875987821248128:12345-0@lo:501: 00000100:00100000:3.0:1789081525.532489:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:7475:x1875987821248128:12345-0@lo:501: Request processed in 352us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081525.532498:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789081525.532775:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:7475:1875987821248128:0@lo:501: 00000100:00100000:0.0:1789081525.532828:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:7475:1875987821248256:0@lo:503: 00000100:00100000:0.0:1789081525.532886:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081525.532935:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c539fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789081525.533184:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821248256 00000100:00100000:3.0:1789081525.533190:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821248256 00000100:00100000:3.0:1789081525.533236:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789081525.533245:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:7475:x1875987821248256:12345-0@lo:503: 00000100:00100000:3.0:1789081525.533817:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:7475:x1875987821248256:12345-0@lo:503: Request processed in 572us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081525.533834:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789081525.534059:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:7475:1875987821248256:0@lo:503: 00000040:00080000:1.0:1789081525.534898:0:7475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789081525.534992:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101c31c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:7475:1875987821248384:0@lo:502: 00000100:00100000:1.0:1789081525.535935:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081525.536071:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821248384 00000100:00100000:2.0:1789081525.536087:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821248384 00000100:00100000:1.0:1789081525.536487:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c8e87780 going to sleep for 11 seconds 00000100:00100000:2.0:1789081525.537099:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789081525.537116:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:7475:x1875987821248384:12345-0@lo:502: 00000100:00100000:2.0:1789081525.537450:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:7475:x1875987821248384:12345-0@lo:502: Request processed in 341us (1518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081525.537458:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789081525.537748:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101c31c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:7475:1875987821248384:0@lo:502: 00000040:00080000:1.0:1789081525.538225:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789081525.538300:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789081525.538335:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789081525.538398:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789081525.538441:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789081525.538479:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789081525.538583:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101c31c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:7475:1875987821248512:0@lo:502: 00000100:00100000:1.0:1789081525.538658:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081525.538699:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c8e87780 going to sleep for 11 seconds 00000100:00100000:0.0:1789081525.540065:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821248512 00000100:00100000:0.0:1789081525.540078:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821248512 00000100:00100000:0.0:1789081525.540160:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789081525.540172:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:7475:x1875987821248512:12345-0@lo:502: 00000100:00100000:0.0:1789081525.540624:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:7475:x1875987821248512:12345-0@lo:502: Request processed in 445us (1956us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081525.540633:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789081525.543158:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101c31c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:7475:1875987821248512:0@lo:502: 00000040:00080000:1.0:1789081525.543439:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789081525.543463:0:7475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1789081525.549029:0:7484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789081525.549046:0:7484:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1789081525.549056:0:7484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789081525.549059:0:7484:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789081525.549066:0:7484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789081525.549100:0:7484:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9e10f9694d40) 00000020:00000080:1.0:1789081525.549134:0:7484:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789081525.549141:0:7484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789081525.549228:0:7484:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e10ff7e6800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789081525.549237:0:7484:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789081525.549244:0:7484:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb7cb3d7479d5f62b 00010000:00010000:2.0:1789081525.568261:0:7484:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1789081525.568694:0:7484:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1789081525.575817:0:7484:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789081525.576338:0:7484:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1789081525.596493:0:7484:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1789081525.597116:0:7484:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1789081525.614986:0:7484:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1789081525.615003:0:7484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789081525.615011:0:7484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789081525.615014:0:7484:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1789081525.615018:0:7484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789081525.615022:0:7484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789081525.615023:0:7484:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789081525.615026:0:7484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789081525.615028:0:7484:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789081525.615106:0:7484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789081525.615110:0:7484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789081525.615111:0:7484:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789081525.615114:0:7484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1789081525.617101:0:7475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1789081525.617151:0:7475:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789081525.617181:0:7475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10e13af200/0xb7cb3d7479d5f616 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f61d expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081525.617196:0:7475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e10e13af200/0xb7cb3d7479d5f616 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f61d expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789081525.617205:0:7475:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e10ff7e6800 from 1 10000000:01000000:2.0:1789081525.617209:0:7475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789081525.617257:0:7475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1c00/0xb7cb3d7479d5f632 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081525.617265:0:7475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1c00/0xb7cb3d7479d5f632 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081525.617277:0:7475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1c00/0xb7cb3d7479d5f632 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081525.617303:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9487480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:7475:1875987821248640:0@lo:101: 00000100:00100000:2.0:1789081525.617398:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081525.617466:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e1101986cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789081525.618472:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821248640 00000100:00100000:0.0:1789081525.618484:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821248640 00000100:00100000:0.0:1789081525.618586:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789081525.618596:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:7475:x1875987821248640:12345-0@lo:101: 00010000:00010000:0.0:1789081525.618615:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081525.618641:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10c0031000/0xb7cb3d7479d5f639 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f632 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081525.618683:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10c0031000/0xb7cb3d7479d5f639 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f632 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081525.618695:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10c0031000/0xb7cb3d7479d5f639 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f632 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081525.618704:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10c0031000, rc 0) 00000100:00100000:0.0:1789081525.618789:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:7475:x1875987821248640:12345-0@lo:101: Request processed in 195us (1391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081525.618796:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789081525.618819:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9487480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:7475:1875987821248640:0@lo:101: 00010000:00010000:2.0:1789081525.618837:0:7475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1c00/0xb7cb3d7479d5f632 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f639 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081525.618848:0:7475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1c00/0xb7cb3d7479d5f632 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f639 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081525.618981:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9487480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:7475:1875987821248768:0@lo:501: 00000100:00100000:2.0:1789081525.619031:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081525.619069:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e1101986cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789081525.619647:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821248768 00000100:00100000:0.0:1789081525.619654:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821248768 00000100:00100000:0.0:1789081525.619687:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789081525.619694:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:7475:x1875987821248768:12345-0@lo:501: 00000100:00100000:0.0:1789081525.620005:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:7475:x1875987821248768:12345-0@lo:501: Request processed in 310us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081525.620013:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789081525.620063:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9487480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:7475:1875987821248768:0@lo:501: 00000100:00100000:0.0:1789081525.620104:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:7475:1875987821248896:0@lo:503: 00000100:00100000:0.0:1789081525.620145:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081525.620185:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d0c9e480 going to sleep for 11 seconds 00000100:00100000:2.0:1789081525.620379:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821248896 00000100:00100000:2.0:1789081525.620384:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821248896 00000100:00100000:2.0:1789081525.620434:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789081525.620442:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:7475:x1875987821248896:12345-0@lo:503: 00000100:00100000:2.0:1789081525.621109:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:7475:x1875987821248896:12345-0@lo:503: Request processed in 664us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081525.621118:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789081525.624554:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:7475:1875987821248896:0@lo:503: 00000040:00080000:0.0:1789081525.625296:0:7475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789081525.625764:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:7475:1875987821249024:0@lo:502: 00000100:00100000:0.0:1789081525.625868:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081525.625928:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10e09bad80 going to sleep for 11 seconds 00000100:00100000:2.0:1789081525.626268:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821249024 00000100:00100000:2.0:1789081525.626277:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821249024 00000100:00100000:2.0:1789081525.626336:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789081525.626347:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:7475:x1875987821249024:12345-0@lo:502: 00000100:00100000:2.0:1789081525.626951:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:7475:x1875987821249024:12345-0@lo:502: Request processed in 604us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081525.626960:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789081525.627069:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:7475:1875987821249024:0@lo:502: 00000040:00080000:3.0:1789081525.627353:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789081525.627411:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789081525.627446:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c50b9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:7475:1875987821249152:0@lo:502: 00000100:00100000:3.0:1789081525.627493:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081525.628005:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821249152 00000100:00100000:3.0:1789081525.628012:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821249152 00000100:00100000:2.0:1789081525.628907:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10f1240180 going to sleep for 11 seconds 00000100:00100000:0.0:1789081525.640834:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789081525.640869:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:7475:x1875987821249152:12345-0@lo:502: 00000100:00100000:0.0:1789081525.641227:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:7475:x1875987821249152:12345-0@lo:502: Request processed in 377us (13732us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081525.641237:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789081525.641269:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c50b9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:7475:1875987821249152:0@lo:502: 00000040:00080000:2.0:1789081525.641480:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1789081525.641499:0:7475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1789081525.642742:0:7488:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789081525.642758:0:7488:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789081525.642762:0:7488:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789081525.642771:0:7488:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e10ff7e6800 00000020:00000080:2.0:1789081525.642774:0:7488:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789081525.642798:0:7488:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789081525.642802:0:7488:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789081525.642803:0:7488:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789081525.642805:0:7488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1789081525.643284:0:7475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789081525.643312:0:7475:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789081525.643340:0:7475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1c00/0xb7cb3d7479d5f632 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f639 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081525.643353:0:7475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1c00/0xb7cb3d7479d5f632 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f639 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789081525.643404:0:7475:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789081525.643408:0:7475:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e10ff7e6800 10000000:01000000:0.0:1789081525.643413:0:7475:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e10ff7e6800 10000000:01000000:0.0:1789081525.643417:0:7475:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789081525.643424:0:7475:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e10ff7e6800 from 1 10000000:01000000:0.0:1789081525.643427:0:7475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789081525.643470:0:7475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c0030a00/0xb7cb3d7479d5f640 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081525.643479:0:7475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e10c0030a00/0xb7cb3d7479d5f640 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081525.643491:0:7475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e10c0030a00/0xb7cb3d7479d5f640 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081525.643554:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:7475:1875987821249280:0@lo:101: 00000100:00100000:2.0:1789081525.643798:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081525.643854:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c8177780 going to sleep for 11 seconds 00000100:00100000:0.0:1789081525.643864:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821249280 00000100:00100000:0.0:1789081525.643871:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821249280 00000100:00100000:0.0:1789081525.643923:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789081525.643931:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:7475:x1875987821249280:12345-0@lo:101: 00010000:00010000:0.0:1789081525.643944:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081525.643957:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10c0031600/0xb7cb3d7479d5f647 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f640 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081525.643979:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10c0031600/0xb7cb3d7479d5f647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f640 expref: 14 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081525.643988:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10c0031600/0xb7cb3d7479d5f647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f640 expref: 14 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081525.643996:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10c0031600, rc 0) 00000100:00100000:0.0:1789081525.644043:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:7475:x1875987821249280:12345-0@lo:101: Request processed in 113us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081525.644052:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789081525.644206:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:7475:1875987821249280:0@lo:101: 00010000:00010000:2.0:1789081525.644221:0:7475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e10c0030a00/0xb7cb3d7479d5f640 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f647 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081525.644230:0:7475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e10c0030a00/0xb7cb3d7479d5f640 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f647 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081525.644736:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9484700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:7475:1875987821249408:0@lo:501: 00000100:00100000:2.0:1789081525.644799:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081525.644895:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e1101986780 going to sleep for 11 seconds 00000100:00100000:0.0:1789081525.657229:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821249408 00000100:00100000:0.0:1789081525.657249:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821249408 00000100:00100000:2.0:1789081525.662940:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789081525.662959:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:7475:x1875987821249408:12345-0@lo:501: 00000100:00100000:2.0:1789081525.665264:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:7475:x1875987821249408:12345-0@lo:501: Request processed in 2298us (20452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081525.665281:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789081525.665403:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9484700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:7475:1875987821249408:0@lo:501: 00000100:00100000:2.0:1789081525.665464:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9484700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:7475:1875987821249536:0@lo:503: 00000100:00100000:2.0:1789081525.665553:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081525.665660:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821249536 00000100:00100000:0.0:1789081525.665667:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821249536 00000100:00100000:0.0:1789081525.665733:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789081525.665743:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:7475:x1875987821249536:12345-0@lo:503: 00000100:00100000:0.0:1789081525.665961:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:7475:x1875987821249536:12345-0@lo:503: Request processed in 220us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081525.665968:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789081525.671728:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e1101986780 going to sleep for 11 seconds 00000100:00100000:2.0:1789081525.671792:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9484700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:7475:1875987821249536:0@lo:503: 00000040:00080000:2.0:1789081525.672519:0:7475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789081525.672922:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9484700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:7475:1875987821249664:0@lo:502: 00000100:00100000:2.0:1789081525.673154:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081525.673262:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e1101986780 going to sleep for 11 seconds 00000100:00100000:0.0:1789081525.677009:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821249664 00000100:00100000:0.0:1789081525.677029:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821249664 00000100:00100000:2.0:1789081525.677214:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789081525.677226:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:7475:x1875987821249664:12345-0@lo:502: 00000100:00100000:2.0:1789081525.677686:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:7475:x1875987821249664:12345-0@lo:502: Request processed in 462us (4531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081525.677695:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789081525.678106:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9484700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:7475:1875987821249664:0@lo:502: 00000040:00080000:0.0:1789081525.678722:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789081525.678797:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789081525.678831:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789081525.678875:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789081525.678903:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789081525.678945:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789081525.678981:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789081525.684112:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789081525.684263:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789081525.684296:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789081525.684323:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789081525.684594:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789081525.684712:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789081525.684795:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789081525.684860:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789081525.684898:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789081525.684926:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789081525.684973:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789081525.685024:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789081525.685057:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789081525.685100:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789081525.685129:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789081525.685157:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789081525.685195:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789081525.685225:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1789081525.685252:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1789081525.685294:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1789081525.685323:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1789081525.685368:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1789081525.686085:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1789081525.686135:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1789081525.686169:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1789081525.686205:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1789081525.686253:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1789081525.686302:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1789081525.686707:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1789081525.686761:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1789081525.686819:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101c31c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:7475:1875987821249792:0@lo:502: 00000100:00100000:1.0:1789081525.686926:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081525.687120:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c8e87600 going to sleep for 11 seconds 00000100:00100000:0.0:1789081525.691771:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821249792 00000100:00100000:0.0:1789081525.691790:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821249792 00000100:00100000:2.0:1789081525.691961:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789081525.691973:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:7475:x1875987821249792:12345-0@lo:502: 00000100:00100000:2.0:1789081525.692647:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:7475:x1875987821249792:12345-0@lo:502: Request processed in 672us (5717us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081525.692658:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789081525.692993:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101c31c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:7475:1875987821249792:0@lo:502: 00000040:00080000:1.0:1789081525.693219:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1789081525.693238:0:7475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1789081525.698752:0:7489:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789081525.698776:0:7489:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9e10f96919c0) 00000020:00000080:1.0:1789081525.698809:0:7489:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1789081525.699675:0:7489:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e10ff7e6800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789081525.699681:0:7489:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e10ff7e6800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789081525.699684:0:7489:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e10ff7e6800 3 00010000:00080000:1.0:1789081525.699729:0:7489:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e1101618800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.117@tcp at head 00010000:00010000:1.0:1789081525.703586:0:7489:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1789081525.703803:0:7489:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789081525.703848:0:7489:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789081525.703866:0:7489:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xb7cb3d7479d5f655 00000100:00080000:1.0:1789081525.703879:0:7489:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789081525.703886:0:7489:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e1101618800 using connection 192.168.201.117@tcp/0@lo 00000100:00100000:1.0:1789081525.703926:0:7489:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e1101c31c00 x1875987821249920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789081525.703963:0:7489:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789081525.704071:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101c31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1875987821249920:0@lo:38: 00000100:00100000:3.0:1789081525.704167:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081525.704242:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821249920 00000100:00100000:3.0:1789081525.704249:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821249920 00000100:00100000:3.0:1789081525.704280:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789081525.704289:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1875987821249920:12345-0@lo:38: 00010000:00080000:3.0:1789081525.704329:0:5789:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:3.0:1789081525.704366:0:5789:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xb7cb3d7479d5f65c 00000004:00100000:3.0:1789081525.704386:0:5789:0:(mdt_handler.c:7406:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789081525.704420:0:5789:0:(import.c:65:import_set_state_nolock()) ffff9e10f9781000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789081525.704492:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875987821249920:12345-0@lo:38: Request processed in 201us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081525.704499:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789081525.704814:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e1101c31c00 x1875987821249920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789081535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789081525.704825:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789081525.704842:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1789081525.704849:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789081525.704854:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789081525.704856:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e1101618800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789081525.704862:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101c31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1875987821249920:0@lo:38: 00000100:00100000:1.0:1789081525.706787:0:7490:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101c31c00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7490:1875987821250048:0@lo:901: 00000040:00080000:3.0:1789081525.706835:0:7489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:1.0:1789081525.706879:0:7490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081525.706922:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821250048 00000100:00100000:1.0:1789081525.706928:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821250048 00000100:00100000:1.0:1789081525.706980:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789081525.706989:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101c31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7490:x1875987821250048:12345-0@lo:901: 00000100:00100000:1.0:1789081525.707825:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101c31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7490:x1875987821250048:12345-0@lo:901: Request processed in 833us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081525.707835:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789081525.707863:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789081525.707881:0:7490:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c8e870c0 going to sleep for 11 seconds 00010000:00080000:1.0:1789081525.707911:0:7490:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e1101c31c00 x1875987821250048/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789081541 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789081525.707926:0:7490:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101c31c00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7490:1875987821250048:0@lo:901: 00000020:01000000:2.0:1789081525.710141:0:7475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1789081525.710193:0:7475:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789081525.710211:0:7475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c0030a00/0xb7cb3d7479d5f640 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f647 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081525.710226:0:7475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e10c0030a00/0xb7cb3d7479d5f640 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f647 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789081525.710302:0:7475:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789081525.710304:0:7475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789081525.710305:0:7475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789081525.710307:0:7475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789081525.710308:0:7475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789081525.710309:0:7475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789081525.710310:0:7475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789081525.710312:0:7475:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789081525.710313:0:7475:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789081525.710315:0:7475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789081525.710317:0:7475:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789081525.710323:0:7475:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1789081525.710325:0:7475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789081525.710327:0:7475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789081525.710328:0:7475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789081525.710329:0:7475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789081525.710330:0:7475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789081525.710331:0:7475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789081525.710344:0:7475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789081525.710345:0:7475:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789081525.710346:0:7475:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789081525.710347:0:7475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789081525.710347:0:7475:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789081525.710378:0:7475:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789081525.710735:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9487b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:7475:1875987821250176:0@lo:253: 00000100:00100000:2.0:1789081525.710827:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081525.710884:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d2d5ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789081525.710886:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821250176 00000100:00100000:3.0:1789081525.710894:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821250176 00000100:00100000:3.0:1789081525.710957:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789081525.710966:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:7475:x1875987821250176:12345-0@lo:253: 20000000:01000000:3.0:1789081525.710996:0:5782:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789081525.711013:0:5782:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1789081525.712273:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789081525.712294:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101c31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875987821250304:0@lo:400: 00000100:00100000:1.0:1789081525.712905:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081525.712975:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101c30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875987821250432:0@lo:400: 00000100:00100000:1.0:1789081525.713515:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081525.713591:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821250304 00000100:00100000:1.0:1789081525.713600:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821250304 00000100:00100000:1.0:1789081525.713755:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821250432 00000100:00100000:1.0:1789081525.713759:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821250432 00000100:00100000:1.0:1789081525.713797:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789081525.713805:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101c32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875987821250304:12345-0@lo:400: 00000100:00100000:1.0:1789081525.713863:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101c32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875987821250304:12345-0@lo:400: Request processed in 59us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081525.713870:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789081525.713886:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789081525.713892:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101c32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875987821250432:12345-0@lo:400: 00000100:00100000:1.0:1789081525.713913:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101c32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875987821250432:12345-0@lo:400: Request processed in 22us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081525.713919:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1789081525.713937:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789081525.713979:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e1101c30000 x1875987821250432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789081541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789081525.713995:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101c30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875987821250432:0@lo:400: 00010000:00080000:1.0:1789081525.714744:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e1101c31c00 x1875987821250304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789081541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789081525.714757:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101c31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875987821250304:0@lo:400: 00000100:00100000:1.0:1789081525.714835:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101c31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821250560:0@lo:400: 00000100:00100000:1.0:1789081525.714888:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081525.714933:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821250560 00000100:00100000:1.0:1789081525.714939:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821250560 00000100:00100000:1.0:1789081525.714980:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789081525.714987:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101c30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821250560:12345-0@lo:400: 00000100:00100000:1.0:1789081525.716141:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101c30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821250560:12345-0@lo:400: Request processed in 1148us (1246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081525.716163:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1789081525.716205:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789081525.716239:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e1101c31c00 x1875987821250560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789081541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789081525.716252:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101c31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821250560:0@lo:400: 20000000:01000000:2.0:1789081525.763566:0:5782:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789081525.763589:0:5782:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1789081525.763838:0:5805:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789081525.763845:0:5805:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789081525.763873:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e1101998600/0xb7cb3d7479d5f663 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.763894:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e10c29e1e00/0xb7cb3d7479d5f5b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f5ad expref: 14 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.763903:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e1101998600/0xb7cb3d7479d5f663 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.763946:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e10c29e1e00/0xb7cb3d7479d5f5b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb7cb3d7479d5f5ad expref: 14 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.763963:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e10c29e1e00/0xb7cb3d7479d5f5b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f5ad expref: 14 pid: 5782 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081525.763996:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c50b9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5805:1875987821250688:0@lo:104: 00000100:00100000:3.0:1789081525.764095:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081525.764159:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10f1240180 going to sleep for 11 seconds 00000100:00100000:2.0:1789081525.764753:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821250688 00000100:00100000:2.0:1789081525.764764:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821250688 00000100:00100000:2.0:1789081525.764833:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789081525.764845:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+3:5805:x1875987821250688:12345-0@lo:104: 00010000:00010000:2.0:1789081525.764861:0:5772:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.117@tcp lock: ffff9e1102045800/0xb7cb3d7479d5f5ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f5b4 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081525.764936:0:5772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789081525.764942:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+3:5805:x1875987821250688:12345-0@lo:104: Request processed in 100us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081525.764949:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1789081525.765769:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789081525.765782:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e1102045800/0xb7cb3d7479d5f5ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f5b4 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.765795:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1102045800 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:3.0:1789081525.765801:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e1102045800/0xb7cb3d7479d5f5ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb7cb3d7479d5f5b4 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.765812:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e1102045800/0xb7cb3d7479d5f5ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb7cb3d7479d5f5b4 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789081525.765821:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e1102045800/0xb7cb3d7479d5f5ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb7cb3d7479d5f5b4 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789081525.765828:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789081525.766036:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e1102045800/0xb7cb3d7479d5f5ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f5b4 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.766046:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789081525.766076:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e1102045800/0xb7cb3d7479d5f5ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f5b4 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.766083:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e1102045800/0xb7cb3d7479d5f5ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f5b4 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.766103:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081525.766116:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081525.766118:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081525.766150:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c50b9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5805:1875987821250688:0@lo:104: 00010000:00010000:3.0:1789081525.766172:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e1101998600/0xb7cb3d7479d5f663 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081525.766303:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c50b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821250816:0@lo:103: 00000100:00100000:2.0:1789081525.766372:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081525.767099:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821250816 00000100:00100000:3.0:1789081525.767108:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821250816 00010000:00010000:3.0:1789081525.767145:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e10c29e1e00/0xb7cb3d7479d5f5b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f5ad expref: 15 pid: 5782 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081525.767217:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789081525.767227:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c9389850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+15:3304:x1875987821250816:12345-0@lo:103: 00010000:00010000:3.0:1789081525.767240:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081525.767245:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e10c29e1e00/0xb7cb3d7479d5f5b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f5ad expref: 15 pid: 5782 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.767256:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e10c29e1e00/0xb7cb3d7479d5f5b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f5ad expref: 15 pid: 5782 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.767271:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10c29e1e00/0xb7cb3d7479d5f5b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb7cb3d7479d5f5ad expref: 15 pid: 5782 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.767287:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e1101998600/0xb7cb3d7479d5f663 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.767295:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e1101998600/0xb7cb3d7479d5f663 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789081525.767309:0:5775:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003466667s 00010000:00010000:3.0:1789081525.767314:0:5775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e1101998600/0xb7cb3d7479d5f663 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.767330:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e1101998600/0xb7cb3d7479d5f663 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.767336:0:5775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e1101998600/0xb7cb3d7479d5f663 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.767344:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e1101998600/0xb7cb3d7479d5f663 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.767350:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998600 already unused, calling callback (ffffffffc1784220) 00010000:00010000:3.0:1789081525.767353:0:5775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e1101998600/0xb7cb3d7479d5f663 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.767360:0:5775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e1101998600/0xb7cb3d7479d5f663 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.767375:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e1101998600/0xb7cb3d7479d5f663 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081525.767384:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789081525.767437:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c9389850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:3304:x1875987821250816:12345-0@lo:103: Request processed in 212us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081525.767444:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789081525.775794:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c50b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821250816:0@lo:103: 00010000:00010000:0.0:1789081525.775847:0:5805:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e1101998600/0xb7cb3d7479d5f663 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081525.775859:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e1101998600/0xb7cb3d7479d5f663 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081525.775865:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e1101998600/0xb7cb3d7479d5f663 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081525.791661:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:7475:x1875987821250176:12345-0@lo:253: Request processed in 80681us (80819us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081525.791681:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789081525.791903:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9487b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ee551687-7675-4fc6-9be1-2ccb62bdd809:7475:1875987821250176:0@lo:253: 10000000:01000000:2.0:1789081525.791922:0:7475:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789081525.791926:0:7475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789081525.791929:0:7475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789081525.791930:0:7475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789081525.791932:0:7475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789081525.791933:0:7475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789081525.791934:0:7475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789081525.791935:0:7475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789081525.791937:0:7475:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789081525.791938:0:7475:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789081525.791940:0:7475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789081525.791941:0:7475:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789081525.791963:0:7475:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789081525.803130:0:7475:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789081525.803443:0:7475:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789081525.803684:0:7475:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789081525.803864:0:7475:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789081525.804077:0:7475:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789081525.804289:0:7475:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789081525.807998:0:7475:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:3.0:1789081526.046417:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1789081526.196193:0:7475:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789081526.196201:0:7475:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789081526.196243:0:7475:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789081526.196305:0:7475:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.117@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789081526.196330:0:7475:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789081526.196362:0:7475:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1789081527.069716:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789081527.132830:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789081527.132862:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821250944:0@lo:13: 00000100:00100000:2.0:1789081527.132956:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081527.133041:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821250944 00000100:00100000:2.0:1789081527.133050:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821250944 00000100:00100000:2.0:1789081527.133114:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789081527.133124:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821250944:12345-0@lo:13: 00002000:00000024:2.0:1789081527.133165:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789081527.133216:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821250944:12345-0@lo:13: Request processed in 94us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081527.133225:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789081527.133249:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10f9487b80 x1875987821250944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081543 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789081527.133251:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789081527.133289:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821250944:0@lo:13: 00010000:00010000:3.0:1789081528.097180:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081529.122772:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081530.140781:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789081530.717281:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821251072:0@lo:400: 00000100:00100000:0.0:1789081530.717384:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081530.717518:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821251072 00000100:00100000:1.0:1789081530.717545:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821251072 00000100:00100000:1.0:1789081530.717602:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789081530.717612:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:3306:x1875987821251072:12345-0@lo:400: 00000100:00100000:1.0:1789081530.722411:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:3306:x1875987821251072:12345-0@lo:400: Request processed in 4787us (5013us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081530.722430:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789081530.722561:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875987821251328:0@lo:400: 00000100:00100000:1.0:1789081530.722644:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081530.722686:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789081530.722693:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875987821251200:0@lo:400: 00000100:00100000:1.0:1789081530.722718:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081530.722755:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821251328 00000100:00100000:1.0:1789081530.722764:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821251328 00000100:00100000:1.0:1789081530.722833:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821251200 00000100:00100000:1.0:1789081530.722836:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821251200 00000100:00100000:1.0:1789081530.722862:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789081530.722869:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101c31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875987821251328:12345-0@lo:400: 00000100:00100000:1.0:1789081530.722924:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101c31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875987821251328:12345-0@lo:400: Request processed in 56us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081530.722931:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789081530.722961:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789081530.722967:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101c33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875987821251200:12345-0@lo:400: 00000100:00100000:1.0:1789081530.722995:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101c33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875987821251200:12345-0@lo:400: Request processed in 28us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081530.723001:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1789081530.723046:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10f9484e00 x1875987821251200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789081546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789081530.723078:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875987821251200:0@lo:400: 00010000:00080000:1.0:1789081530.723089:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10f9485180 x1875987821251328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789081546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789081530.723098:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875987821251328:0@lo:400: 00000100:00100000:3.0:1789081530.727281:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821251456:0@lo:400: 00000100:00100000:3.0:1789081530.727376:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789081530.727464:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789081530.727490:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821251456 00000100:00100000:3.0:1789081530.727498:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821251456 00000100:00100000:3.0:1789081530.727589:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789081530.727599:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821251456:12345-0@lo:400: 00000100:00100000:2.0:1789081530.731909:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789081530.731939:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875987821251584:0@lo:400: 00000100:00100000:2.0:1789081530.732023:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081530.732095:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821251584 00000100:00100000:2.0:1789081530.732104:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821251584 00000100:00100000:2.0:1789081530.732164:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789081530.732173:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875987821251584:12345-0@lo:400: 00000100:00100000:2.0:1789081530.732225:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875987821251584:12345-0@lo:400: Request processed in 54us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081530.732232:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1789081530.732276:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10f9484700 x1875987821251584/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789081546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789081530.732291:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875987821251584:0@lo:400: 00000100:00080000:2.0:1789081530.732344:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789081530.732358:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789081530.738154:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821251072:0@lo:400: 00000100:00100000:2.0:1789081530.748282:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821251456:12345-0@lo:400: Request processed in 20672us (20893us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081530.748302:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789081530.748368:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10f9486d80 x1875987821251456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789081546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789081530.748385:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821251456:0@lo:400: 00010000:00010000:3.0:1789081531.166510:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081532.188739:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081532.257640:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c50b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821251712:0@lo:13: 00000100:00100000:3.0:1789081532.257739:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081532.257827:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821251712 00000100:00100000:3.0:1789081532.257837:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821251712 00000100:00100000:3.0:1789081532.257893:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789081532.257902:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821251712:12345-0@lo:13: 00002000:00000024:3.0:1789081532.257938:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789081532.257984:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821251712:12345-0@lo:13: Request processed in 82us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081532.257991:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1789081532.258015:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789081532.258047:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10c50b9500 x1875987821251712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081548 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789081532.258067:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c50b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821251712:0@lo:13: 10000000:01000000:3.0:1789081532.259791:0:5786:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789081532.259809:0:5786:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e10fad3e000 from 30 10000000:01000000:3.0:1789081532.259816:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789081532.259859:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101999600/0xb7cb3d7479d5f66a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081532.259872:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e1101999600/0xb7cb3d7479d5f66a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081532.259882:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e1101999600/0xb7cb3d7479d5f66a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081532.259906:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c50b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821251840:0@lo:101: 00000100:00100000:3.0:1789081532.259970:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081532.260017:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10fa800240 going to sleep for 11 seconds 00000100:00100000:1.0:1789081532.260083:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821251840 00000100:00100000:1.0:1789081532.260090:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821251840 00000100:00100000:1.0:1789081532.260143:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789081532.260152:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:5786:x1875987821251840:12345-0@lo:101: 00010000:00010000:1.0:1789081532.260164:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081532.260178:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10e13ae600/0xb7cb3d7479d5f671 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f66a expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081532.260201:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10e13ae600/0xb7cb3d7479d5f671 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f66a expref: 14 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081532.260213:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10e13ae600/0xb7cb3d7479d5f671 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f66a expref: 14 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081532.260223:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13ae600, rc 0) 00000100:00100000:1.0:1789081532.260266:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:5786:x1875987821251840:12345-0@lo:101: Request processed in 116us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081532.260273:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789081532.260672:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c50b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821251840:0@lo:101: 00010000:00010000:3.0:1789081532.260688:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e1101999600/0xb7cb3d7479d5f66a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f671 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081532.260698:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e1101999600/0xb7cb3d7479d5f66a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f671 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081532.260761:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c50b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821251968:0@lo:501: 00000100:00100000:3.0:1789081532.260788:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081532.260818:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10fa800240 going to sleep for 11 seconds 00000100:00100000:1.0:1789081532.260874:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821251968 00000100:00100000:1.0:1789081532.260879:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821251968 00000100:00100000:1.0:1789081532.260913:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789081532.260921:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:5786:x1875987821251968:12345-0@lo:501: 00000100:00100000:1.0:1789081532.261214:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:5786:x1875987821251968:12345-0@lo:501: Request processed in 293us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081532.261222:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789081532.262188:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c50b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821251968:0@lo:501: 00000100:00100000:3.0:1789081532.262238:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c50b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821252096:0@lo:503: 00000100:00100000:3.0:1789081532.262291:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081532.262334:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10fa800240 going to sleep for 11 seconds 00000100:00100000:1.0:1789081532.263678:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821252096 00000100:00100000:1.0:1789081532.263692:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821252096 00000100:00100000:1.0:1789081532.263763:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789081532.263776:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:5786:x1875987821252096:12345-0@lo:503: 00000100:00100000:1.0:1789081532.265490:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:5786:x1875987821252096:12345-0@lo:503: Request processed in 1705us (3187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081532.265505:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789081532.272732:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c50b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821252096:0@lo:503: 00000100:00100000:2.0:1789081532.284681:0:7770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9486d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:7770:1875987821252224:0@lo:502: 00000100:00100000:2.0:1789081532.284793:0:7770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081532.284844:0:7770:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10f948e600 going to sleep for 11 seconds 00000100:00100000:3.0:1789081532.284926:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821252224 00000100:00100000:3.0:1789081532.284934:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821252224 00000100:00100000:3.0:1789081532.284985:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789081532.284995:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:7770:x1875987821252224:12345-0@lo:502: 00000100:00100000:3.0:1789081532.285271:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:7770:x1875987821252224:12345-0@lo:502: Request processed in 276us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081532.285279:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789081532.286257:0:7770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9486d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:7770:1875987821252224:0@lo:502: 00000100:00100000:2.0:1789081532.286471:0:7770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9486d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:7770:1875987821252352:0@lo:502: 00000100:00100000:2.0:1789081532.286558:0:7770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081532.286609:0:7770:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10f948e600 going to sleep for 11 seconds 00000100:00100000:0.0:1789081532.289807:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821252352 00000100:00100000:0.0:1789081532.289824:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821252352 00000100:00100000:0.0:1789081532.289882:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789081532.289893:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:7770:x1875987821252352:12345-0@lo:502: 00000100:00100000:0.0:1789081532.290250:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:7770:x1875987821252352:12345-0@lo:502: Request processed in 357us (3689us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081532.290259:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789081532.290386:0:7770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9486d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:7770:1875987821252352:0@lo:502: 00000040:00080000:2.0:1789081532.290438:0:7770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1789081532.290799:0:5786:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789081532.290823:0:5786:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789081532.290835:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101999600/0xb7cb3d7479d5f66a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f671 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081532.290847:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e1101999600/0xb7cb3d7479d5f66a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f671 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789081532.290858:0:5786:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789081532.290861:0:5786:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1789081532.290865:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789081532.290900:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c0031400/0xb7cb3d7479d5f678 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081532.290909:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e10c0031400/0xb7cb3d7479d5f678 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081532.290920:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e10c0031400/0xb7cb3d7479d5f678 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081532.290940:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821252480:0@lo:101: 00000100:00100000:0.0:1789081532.290985:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081532.291033:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c8e87780 going to sleep for 11 seconds 00000100:00100000:2.0:1789081532.291487:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821252480 00000100:00100000:2.0:1789081532.291494:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821252480 00000100:00100000:2.0:1789081532.291559:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789081532.291569:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:5786:x1875987821252480:12345-0@lo:101: 00010000:00010000:2.0:1789081532.291582:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081532.291607:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10c29e1000/0xb7cb3d7479d5f67f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f678 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081532.291632:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10c29e1000/0xb7cb3d7479d5f67f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f678 expref: 15 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081532.291654:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10c29e1000/0xb7cb3d7479d5f67f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f678 expref: 15 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081532.291663:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10c29e1000, rc 0) 00000100:00100000:2.0:1789081532.291709:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+15:5786:x1875987821252480:12345-0@lo:101: Request processed in 142us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081532.291714:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789081532.292555:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821252480:0@lo:101: 00010000:00010000:0.0:1789081532.292576:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e10c0031400/0xb7cb3d7479d5f678 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f67f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081532.292609:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e10c0031400/0xb7cb3d7479d5f678 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f67f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081532.292681:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821252608:0@lo:501: 00000100:00100000:0.0:1789081532.292725:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081532.292772:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c8e87780 going to sleep for 11 seconds 00000100:00100000:0.0:1789081532.292794:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821252608 00000100:00100000:0.0:1789081532.292799:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821252608 00000100:00100000:0.0:1789081532.292831:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789081532.292839:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+15:5786:x1875987821252608:12345-0@lo:501: 00000100:00100000:0.0:1789081532.293139:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+15:5786:x1875987821252608:12345-0@lo:501: Request processed in 299us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081532.293147:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789081532.293179:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821252608:0@lo:501: 00000100:00100000:0.0:1789081532.293209:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821252736:0@lo:503: 00000100:00100000:0.0:1789081532.293248:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081532.293262:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c8e87780 going to sleep for 11 seconds 00000100:00100000:0.0:1789081532.293274:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821252736 00000100:00100000:0.0:1789081532.293278:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821252736 00000100:00100000:0.0:1789081532.293294:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789081532.293299:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+15:5786:x1875987821252736:12345-0@lo:503: 00000100:00100000:0.0:1789081532.297941:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+15:5786:x1875987821252736:12345-0@lo:503: Request processed in 4630us (4682us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081532.297957:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789081532.298045:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821252736:0@lo:503: 00000100:00100000:2.0:1789081532.299133:0:7773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9486d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:7773:1875987821252864:0@lo:502: 00000100:00100000:2.0:1789081532.299227:0:7773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081532.299277:0:7773:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10fa800240 going to sleep for 11 seconds 00000100:00100000:0.0:1789081532.299478:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821252864 00000100:00100000:0.0:1789081532.299486:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821252864 00000100:00100000:0.0:1789081532.300843:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789081532.300861:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+15:7773:x1875987821252864:12345-0@lo:502: 00000100:00100000:0.0:1789081532.301209:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+15:7773:x1875987821252864:12345-0@lo:502: Request processed in 353us (1980us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081532.301217:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789081532.301339:0:7773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9486d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:7773:1875987821252864:0@lo:502: 00000020:01000000:3.0:1789081532.301374:0:7773:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789081532.301387:0:7773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789081532.301389:0:7773:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789081532.301395:0:7773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789081532.301397:0:7773:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789081532.301576:0:7773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c50b9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:7773:1875987821252992:0@lo:502: 00000100:00100000:3.0:1789081532.301636:0:7773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081532.304991:0:7773:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d1543a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789081532.308495:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821252992 00000100:00100000:2.0:1789081532.308513:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821252992 00000100:00100000:2.0:1789081532.308615:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789081532.308627:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+15:7773:x1875987821252992:12345-0@lo:502: 00000100:00100000:2.0:1789081532.308932:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+15:7773:x1875987821252992:12345-0@lo:502: Request processed in 307us (7295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081532.308940:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789081532.311357:0:7773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c50b9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:7773:1875987821252992:0@lo:502: 00000020:01000000:3.0:1789081532.311407:0:7773:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789081532.311420:0:7773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789081532.311423:0:7773:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789081532.311427:0:7773:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1789081532.312966:0:5786:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1789081532.313002:0:5786:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789081532.313015:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c0031400/0xb7cb3d7479d5f678 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f67f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081532.313029:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e10c0031400/0xb7cb3d7479d5f678 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f67f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789081532.313042:0:5786:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789081532.313046:0:5786:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e10ee974800 from 30 10000000:01000000:1.0:1789081532.313048:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789081532.313098:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10e13aee00/0xb7cb3d7479d5f686 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081532.313106:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e10e13aee00/0xb7cb3d7479d5f686 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081532.313117:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e10e13aee00/0xb7cb3d7479d5f686 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081532.313139:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101c31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821253120:0@lo:101: 00000100:00100000:1.0:1789081532.313215:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081532.313309:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c60c2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789081532.315773:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821253120 00000100:00100000:0.0:1789081532.315789:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821253120 00000100:00100000:1.0:1789081532.315930:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789081532.315940:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+15:5786:x1875987821253120:12345-0@lo:101: 00010000:00010000:1.0:1789081532.315958:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081532.315979:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10e13afc00/0xb7cb3d7479d5f68d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f686 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081532.316012:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10e13afc00/0xb7cb3d7479d5f68d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f686 expref: 16 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081532.316022:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10e13afc00/0xb7cb3d7479d5f68d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f686 expref: 16 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081532.316031:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13afc00, rc 0) 00000100:00100000:1.0:1789081532.316127:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:5786:x1875987821253120:12345-0@lo:101: Request processed in 188us (2911us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081532.316134:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789081532.316256:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101c31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821253120:0@lo:101: 00010000:00010000:0.0:1789081532.316278:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e10e13aee00/0xb7cb3d7479d5f686 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f68d expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081532.316288:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e10e13aee00/0xb7cb3d7479d5f686 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f68d expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081532.318535:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821253248:0@lo:501: 00000100:00100000:0.0:1789081532.318648:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081532.318711:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c8e870c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789081532.318743:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821253248 00000100:00100000:0.0:1789081532.318751:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821253248 00000100:00100000:0.0:1789081532.318800:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789081532.318809:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:5786:x1875987821253248:12345-0@lo:501: 00000100:00100000:0.0:1789081532.319133:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:5786:x1875987821253248:12345-0@lo:501: Request processed in 325us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081532.319141:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789081532.319191:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821253248:0@lo:501: 00000100:00100000:0.0:1789081532.319248:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821253376:0@lo:503: 00000100:00100000:0.0:1789081532.319286:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081532.319306:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c8e870c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789081532.324100:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821253376 00000100:00100000:1.0:1789081532.324119:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821253376 00000100:00100000:1.0:1789081532.324207:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789081532.324217:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:5786:x1875987821253376:12345-0@lo:503: 00000100:00100000:1.0:1789081532.325762:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:5786:x1875987821253376:12345-0@lo:503: Request processed in 1538us (6466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081532.325775:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789081532.329668:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821253376:0@lo:503: 00000100:00100000:1.0:1789081532.340174:0:7774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101c30700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:7774:1875987821253504:0@lo:502: 00000100:00100000:1.0:1789081532.340281:0:7774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081532.340353:0:7774:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c60c2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789081532.340561:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821253504 00000100:00100000:0.0:1789081532.340569:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821253504 00000100:00100000:0.0:1789081532.340635:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789081532.340645:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:7774:x1875987821253504:12345-0@lo:502: 00000100:00100000:0.0:1789081532.340943:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:7774:x1875987821253504:12345-0@lo:502: Request processed in 298us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081532.340951:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789081532.341080:0:7774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101c30700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:7774:1875987821253504:0@lo:502: 00000100:00100000:3.0:1789081532.341139:0:7774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c50b9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:7774:1875987821253632:0@lo:502: 00000100:00100000:3.0:1789081532.341179:0:7774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081532.341213:0:7774:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d1543a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789081532.341257:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821253632 00000100:00100000:0.0:1789081532.341261:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821253632 00000100:00100000:0.0:1789081532.341286:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789081532.341293:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:7774:x1875987821253632:12345-0@lo:502: 00000100:00100000:0.0:1789081532.341616:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:7774:x1875987821253632:12345-0@lo:502: Request processed in 321us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081532.341623:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789081532.341733:0:7774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c50b9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:7774:1875987821253632:0@lo:502: 00000040:00080000:3.0:1789081532.341752:0:7774:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1789081532.341922:0:5786:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789081532.341945:0:5786:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789081532.341956:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10e13aee00/0xb7cb3d7479d5f686 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f68d expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081532.341968:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e10e13aee00/0xb7cb3d7479d5f686 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f68d expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789081532.341979:0:5786:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789081532.341982:0:5786:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e10ee974800 from 5 10000000:01000000:0.0:1789081532.341985:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789081532.342024:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c0030e00/0xb7cb3d7479d5f694 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081532.342033:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e10c0030e00/0xb7cb3d7479d5f694 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081532.342042:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e10c0030e00/0xb7cb3d7479d5f694 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081532.342058:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821253760:0@lo:101: 00000100:00100000:0.0:1789081532.342092:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081532.342116:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d17d3300 going to sleep for 11 seconds 00000100:00100000:0.0:1789081532.342129:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821253760 00000100:00100000:0.0:1789081532.342133:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821253760 00000100:00100000:0.0:1789081532.342158:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789081532.342164:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:5786:x1875987821253760:12345-0@lo:101: 00010000:00010000:0.0:1789081532.342172:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081532.342186:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10c0030200/0xb7cb3d7479d5f69b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f694 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081532.342208:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10c0030200/0xb7cb3d7479d5f69b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f694 expref: 17 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081532.342219:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10c0030200/0xb7cb3d7479d5f69b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f694 expref: 17 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081532.342227:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10c0030200, rc 0) 00000100:00100000:0.0:1789081532.342257:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:5786:x1875987821253760:12345-0@lo:101: Request processed in 92us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081532.342263:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789081532.342301:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821253760:0@lo:101: 00010000:00010000:0.0:1789081532.342313:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e10c0030e00/0xb7cb3d7479d5f694 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f69b expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081532.343778:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e10c0030e00/0xb7cb3d7479d5f694 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f69b expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081532.343873:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821253888:0@lo:256: 00000100:00100000:0.0:1789081532.343941:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081532.344034:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d17d3300 going to sleep for 11 seconds 00000100:00100000:1.0:1789081532.356677:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821253888 00000100:00100000:1.0:1789081532.356698:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821253888 00000100:00100000:1.0:1789081532.356778:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789081532.356792:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:5786:x1875987821253888:12345-0@lo:256: 20000000:01000000:1.0:1789081532.356824:0:5784:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789081532.356853:0:5784:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789081532.356857:0:5784:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1789081532.357022:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:5786:x1875987821253888:12345-0@lo:256: Request processed in 233us (13080us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081532.357030:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789081532.358461:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821253888:0@lo:256: 10000000:01000000:2.0:1789081532.358635:0:5786:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789081532.358648:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c0030e00/0xb7cb3d7479d5f694 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f69b expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081532.358660:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e10c0030e00/0xb7cb3d7479d5f694 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f69b expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789081532.358671:0:5786:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789081532.358686:0:5786:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1789081532.358690:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789081532.358725:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1200/0xb7cb3d7479d5f6a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081532.358733:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1200/0xb7cb3d7479d5f6a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081532.358742:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1200/0xb7cb3d7479d5f6a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081532.358761:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9484700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821254016:0@lo:101: 00000100:00100000:2.0:1789081532.358819:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081532.358900:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c5067d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789081532.366589:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821254016 00000100:00100000:1.0:1789081532.366617:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821254016 00000100:00100000:1.0:1789081532.366700:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789081532.366712:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:5786:x1875987821254016:12345-0@lo:101: 00010000:00010000:1.0:1789081532.366730:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081532.366753:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10e13af400/0xb7cb3d7479d5f6a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f6a2 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081532.366807:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10e13af400/0xb7cb3d7479d5f6a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f6a2 expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081532.366819:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10e13af400/0xb7cb3d7479d5f6a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f6a2 expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081532.366828:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13af400, rc 0) 00000100:00100000:1.0:1789081532.366929:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:5786:x1875987821254016:12345-0@lo:101: Request processed in 220us (8110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081532.366937:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789081532.367018:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9484700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821254016:0@lo:101: 00010000:00010000:1.0:1789081532.367039:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1200/0xb7cb3d7479d5f6a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f6a9 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081532.367051:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1200/0xb7cb3d7479d5f6a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f6a9 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081532.367129:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101c30a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821254144:0@lo:501: 00000100:00100000:1.0:1789081532.367164:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081532.367203:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d12f3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789081532.367314:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821254144 00000100:00100000:0.0:1789081532.367332:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821254144 00000100:00100000:0.0:1789081532.367369:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789081532.367377:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:5786:x1875987821254144:12345-0@lo:501: 00000100:00100000:0.0:1789081532.367928:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:5786:x1875987821254144:12345-0@lo:501: Request processed in 549us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081532.367938:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789081532.367981:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101c30a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821254144:0@lo:501: 00000100:00100000:0.0:1789081532.368022:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821254272:0@lo:503: 00000100:00100000:0.0:1789081532.368069:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081532.368088:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d17d3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789081532.368105:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821254272 00000100:00100000:0.0:1789081532.368109:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821254272 00000100:00100000:0.0:1789081532.368133:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789081532.368140:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:5786:x1875987821254272:12345-0@lo:503: 00000100:00100000:0.0:1789081532.368781:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:5786:x1875987821254272:12345-0@lo:503: Request processed in 638us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081532.368799:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789081532.368966:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821254272:0@lo:503: 00000100:00100000:0.0:1789081532.369859:0:7777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:7777:1875987821254400:0@lo:502: 00000100:00100000:0.0:1789081532.369919:0:7777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081532.369962:0:7777:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d17d3300 going to sleep for 11 seconds 00000100:00100000:1.0:1789081532.370011:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821254400 00000100:00100000:1.0:1789081532.370017:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821254400 00000100:00100000:1.0:1789081532.370058:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789081532.370066:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:7777:x1875987821254400:12345-0@lo:502: 00000100:00100000:1.0:1789081532.370517:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:7777:x1875987821254400:12345-0@lo:502: Request processed in 451us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081532.370545:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789081532.370720:0:7777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:7777:1875987821254400:0@lo:502: 00000020:01000000:2.0:1789081532.370753:0:7777:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789081532.370763:0:7777:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789081532.370771:0:7777:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789081532.370774:0:7777:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789081532.370779:0:7777:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789081532.370784:0:7777:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.117@tcp to nid 0x20000c0a8c975 (192.168.201.117@tcp) 00000020:01000000:2.0:1789081532.370812:0:7777:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789081532.370815:0:7777:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789081532.370831:0:7777:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9e10ff7d4d40) 00000020:00000080:2.0:1789081532.370858:0:7777:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1789081532.370863:0:7777:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789081532.370958:0:7777:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789081532.370964:0:7777:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789081532.370975:0:7777:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb7cb3d7479d5f6b7 00010000:00080000:2.0:1789081532.371005:0:7777:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e0fc3a1a800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.117@tcp at head 00010000:00010000:2.0:1789081532.371238:0:7777:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1789081532.371797:0:7777:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1789081532.371814:0:7777:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789081532.372631:0:7777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789081532.372856:0:7777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789081532.372904:0:7777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1789081532.372965:0:7777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1789081532.376351:0:7778:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789081532.376360:0:7778:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789081532.377618:0:7777:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789081532.377635:0:7777:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789081532.377670:0:7777:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789081532.377700:0:7777:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb7cb3d7479d5f6be 00000100:00080000:2.0:1789081532.377712:0:7777:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789081532.377719:0:7777:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e0fc3a1a800 using connection 192.168.201.117@tcp/0@lo 00000100:00100000:2.0:1789081532.377754:0:7777:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e10f9485f80 x1875987821254528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789081532.377777:0:7777:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789081532.377831:0:7777:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789081532.377835:0:7777:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789081532.377837:0:7777:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789081532.377840:0:7777:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789081532.377845:0:7777:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789081532.377846:0:7777:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789081532.377849:0:7777:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789081532.377851:0:7777:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789081532.377881:0:7777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9484700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:7777:1875987821254656:0@lo:502: 00000100:00100000:2.0:1789081532.377978:0:7777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081532.378023:0:7777:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c5067300 going to sleep for 11 seconds 00000100:00100000:2.0:1789081532.378108:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875987821254912:0@lo:400: 00000100:00100000:2.0:1789081532.378148:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081532.378169:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789081532.378176:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875987821255040:0@lo:400: 00000100:00100000:2.0:1789081532.378196:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081532.378304:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875987821254528:0@lo:8: 00000100:00100000:1.0:1789081532.378358:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081532.378414:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821254656 00000100:00100000:1.0:1789081532.378422:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821254656 00000100:00100000:1.0:1789081532.378467:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789081532.378475:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:7777:x1875987821254656:12345-0@lo:502: 00000100:00100000:1.0:1789081532.378797:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:7777:x1875987821254656:12345-0@lo:502: Request processed in 321us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081532.378806:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789081532.378850:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821254912 00000100:00100000:1.0:1789081532.378855:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821254912 00000100:00100000:1.0:1789081532.378897:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821255040 00000100:00100000:1.0:1789081532.378899:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821255040 00000100:00100000:1.0:1789081532.378918:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789081532.378925:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875987821254912:12345-0@lo:400: 00000100:00100000:1.0:1789081532.378967:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875987821254912:12345-0@lo:400: Request processed in 42us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081532.378974:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789081532.378985:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789081532.378991:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875987821255040:12345-0@lo:400: 00000100:00100000:1.0:1789081532.379017:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875987821255040:12345-0@lo:400: Request processed in 27us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081532.379023:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1789081532.379074:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10f9485180 x1875987821255040/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789081548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789081532.379088:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875987821255040:0@lo:400: 00010000:00080000:1.0:1789081532.379099:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10f9484380 x1875987821254912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789081548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789081532.379116:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875987821254912:0@lo:400: 00000100:00100000:2.0:1789081532.379474:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821254528 00000100:00100000:2.0:1789081532.379481:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821254528 00000100:00100000:2.0:1789081532.380533:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789081532.380544:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3302:x1875987821254528:12345-0@lo:8: 00010000:00080000:2.0:1789081532.380580:0:6582:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:2.0:1789081532.380633:0:6582:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb7cb3d7479d5f6c5 00002000:00100000:2.0:1789081532.380650:0:6582:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9e0fc3a1b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113719 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789081532.380654:0:6582:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1789081532.380659:0:6582:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1789081532.380824:0:6582:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789081532.380990:0:6582:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789081532.381017:0:6582:0:(import.c:65:import_set_state_nolock()) ffff9e0fc3a1b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789081532.381102:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1875987821254528:12345-0@lo:8: Request processed in 558us (2742us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081532.381111:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789081532.381243:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875987821254784:0@lo:400: 00000100:00100000:3.0:1789081532.381289:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789081532.382488:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789081532.382511:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821254784 00000100:00100000:3.0:1789081532.382535:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821254784 00000100:00100000:3.0:1789081532.382605:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789081532.382616:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875987821254784:12345-0@lo:400: 00000100:00100000:3.0:1789081532.382697:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875987821254784:12345-0@lo:400: Request processed in 83us (1408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081532.382706:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1789081532.382755:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10f9486d80 x1875987821254784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789081548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789081532.382771:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875987821254784:0@lo:400: 00000100:00100000:3.0:1789081532.385594:0:7777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9484700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:7777:1875987821254656:0@lo:502: 00000020:01000000:3.0:1789081532.385660:0:7777:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789081532.385673:0:7777:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789081532.385676:0:7777:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789081532.385682:0:7777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00010000:00080000:3.0:1789081532.387652:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10f9485f80 x1875987821254528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789081542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789081532.387671:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789081532.387681:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789081532.387691:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789081532.387698:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789081532.387702:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e0fc3a1a800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789081532.387729:0:3302:0:(osp_dev.c:1791:osp_import_event()) got connected 00000100:00100000:3.0:1789081532.387736:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875987821254528:0@lo:8: 00000004:00080000:3.0:1789081532.387775:0:7778:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789081532.387950:0:7778:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 199270425375ns, next at 0ns, rc = 0 00000020:01000000:2.0:1789081532.390830:0:5786:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1789081532.390871:0:5786:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789081532.390885:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1200/0xb7cb3d7479d5f6a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f6a9 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081532.390899:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1200/0xb7cb3d7479d5f6a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f6a9 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789081532.390911:0:5786:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789081532.390923:0:5786:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9e10d1a03380 from 1 10000000:01000000:2.0:1789081532.390927:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789081532.390973:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1e00/0xb7cb3d7479d5f6cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081532.390981:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1e00/0xb7cb3d7479d5f6cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081532.390991:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1e00/0xb7cb3d7479d5f6cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081532.391016:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9485f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821255168:0@lo:101: 00000100:00100000:2.0:1789081532.391106:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081532.391156:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c5067a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789081532.391503:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821255168 00000100:00100000:1.0:1789081532.391512:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821255168 00000100:00100000:1.0:1789081532.391586:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789081532.391606:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:5786:x1875987821255168:12345-0@lo:101: 00010000:00010000:1.0:1789081532.391621:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081532.391640:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10e13aea00/0xb7cb3d7479d5f6d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f6cc expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081532.391666:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10e13aea00/0xb7cb3d7479d5f6d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f6cc expref: 19 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081532.391676:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10e13aea00/0xb7cb3d7479d5f6d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f6cc expref: 19 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081532.391685:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13aea00, rc 0) 00000100:00100000:1.0:1789081532.391728:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:5786:x1875987821255168:12345-0@lo:101: Request processed in 134us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081532.391735:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789081532.399413:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9485f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821255168:0@lo:101: 00010000:00010000:2.0:1789081532.399448:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1e00/0xb7cb3d7479d5f6cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f6d3 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081532.399463:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1e00/0xb7cb3d7479d5f6cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f6d3 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081532.399574:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9485f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821255296:0@lo:501: 00000100:00100000:2.0:1789081532.399666:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081532.399731:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c5067a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789081532.404244:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821255296 00000100:00100000:1.0:1789081532.404261:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821255296 00000100:00100000:1.0:1789081532.404323:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789081532.404334:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:5786:x1875987821255296:12345-0@lo:501: 00000100:00100000:1.0:1789081532.404678:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:5786:x1875987821255296:12345-0@lo:501: Request processed in 345us (5010us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789081532.404687:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789081532.405297:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9485f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821255296:0@lo:501: 10000000:01000000:1.0:1789081532.405347:0:5786:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789081532.405357:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1e00/0xb7cb3d7479d5f6cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f6d3 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081532.405368:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1e00/0xb7cb3d7479d5f6cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f6d3 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789081532.467336:0:5811:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1789081532.523233:0:7779:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789081532.523256:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101c30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821255424:0@lo:13: 00000100:00100000:1.0:1789081532.523266:0:7779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101c30a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7779:1875987821255552:0@lo:7: 00000100:00100000:1.0:1789081532.523694:0:7779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081532.523761:0:7779:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c923fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1789081532.524521:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821255552 00000100:00100000:0.0:1789081532.524555:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821255552 00000100:00100000:0.0:1789081532.524646:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789081532.524657:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7779:x1875987821255552:12345-0@lo:7: 00000100:00100000:3.0:1789081532.527509:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789081532.527621:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789081532.527637:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821255424 00000100:00100000:3.0:1789081532.527645:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821255424 00000100:00100000:3.0:1789081532.527696:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789081532.527705:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1875987821255424:12345-0@lo:13: 00002000:00000024:3.0:1789081532.527736:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1789081532.527785:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1875987821255424:12345-0@lo:13: Request processed in 81us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081532.527792:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789081532.527836:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e1101c30e00 x1875987821255424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081548 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789081532.527856:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101c30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821255424:0@lo:13: 00002000:00080000:0.0:1789081532.539868:0:6584:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1789081532.539880:0:6584:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789081532.540016:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7779:x1875987821255552:12345-0@lo:7: Request processed in 15356us (16317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081532.540029:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789081532.540211:0:7779:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e1101c30a80 x1875987821255552/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789081548 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789081532.540229:0:7779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101c30a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7779:1875987821255552:0@lo:7: 00000004:00080000:1.0:1789081532.540244:0:7779:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1789081532.540283:0:7779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101c30a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7779:1875987821255680:0@lo:5: 00000100:00100000:1.0:1789081532.540319:0:7779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081532.540361:0:7779:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c923fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1789081532.541472:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821255680 00000100:00100000:0.0:1789081532.541484:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821255680 00000100:00100000:0.0:1789081532.541551:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789081532.541561:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101c31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7779:x1875987821255680:12345-0@lo:5: 00002000:00080000:0.0:1789081532.541591:0:6582:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789081532.541604:0:6582:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1789081532.542001:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101c31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7779:x1875987821255680:12345-0@lo:5: Request processed in 441us (1681us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789081532.542009:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789081532.542162:0:7779:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e1101c30a80 x1875987821255680/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789081548 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789081532.542180:0:7779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101c30a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7779:1875987821255680:0@lo:5: 00000004:00080000:2.0:1789081532.542192:0:7779:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1789081532.542239:0:7779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9484700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7779:1875987821255808:0@lo:700: 00000100:00100000:2.0:1789081532.542275:0:7779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081532.542305:0:7779:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c5067e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789081532.542492:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821255808 00000100:00100000:0.0:1789081532.542498:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821255808 00000100:00100000:0.0:1789081532.542546:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789081532.542554:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9486d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7779:x1875987821255808:12345-0@lo:700: 00000100:00100000:0.0:1789081532.542587:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b5500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6590:1875987821255936:0@lo:700: 00000100:00100000:0.0:1789081532.542639:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081532.542657:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c33ff000 going to sleep for 11 seconds 00000100:00100000:0.0:1789081532.545669:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821255936 00000100:00100000:0.0:1789081532.545691:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821255936 00000100:00100000:0.0:1789081532.545766:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789081532.545777:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6590:x1875987821255936:12345-0@lo:700: 40000000:02000000:0.0:1789081532.580252:0:5796:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1789081532.592455:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6590:x1875987821255936:12345-0@lo:700: Request processed in 46669us (49803us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081532.592472:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789081532.592601:0:6590:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e11010b5500 x1875987821255936/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789081548 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789081532.592619:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b5500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6590:1875987821255936:0@lo:700: 40000000:02000000:1.0:1789081532.592637:0:6590:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:2.0:1789081532.711036:0:7493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1789081532.711075:0:7493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789081532.711265:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9486d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7779:x1875987821255808:12345-0@lo:700: Request processed in 168707us (168984us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081532.711279:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789081532.711480:0:7779:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10f9484700 x1875987821255808/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789081548 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789081532.711492:0:7779:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789081532.711509:0:7779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9484700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7779:1875987821255808:0@lo:700: 00000004:02000040:2.0:1789081532.797218:0:7779:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1789081532.801061:0:7779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9484700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7779:1875987821256064:0@lo:5: 00000100:00100000:2.0:1789081532.801154:0:7779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081532.801232:0:7779:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c5067300 going to sleep for 11 seconds 00000100:00100000:0.0:1789081532.802462:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821256064 00000100:00100000:0.0:1789081532.802477:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821256064 00000100:00100000:0.0:1789081532.802563:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789081532.802573:0:6582:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789081532.802575:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7779:x1875987821256064:12345-0@lo:5: 00000100:00100000:2.0:1789081532.802584:0:6582:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00080000:0.0:1789081532.810134:0:6584:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1789081532.810161:0:6584:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1789081532.818148:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7779:x1875987821256064:12345-0@lo:5: Request processed in 15565us (16983us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789081532.818164:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789081532.818813:0:7779:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10f9484700 x1875987821256064/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789081548 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081532.818833:0:7779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9484700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7779:1875987821256064:0@lo:5: 00000004:00080000:0.0:1789081532.818849:0:7779:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1789081533.214294:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789081533.385722:0:7842:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg117-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789081534.239409:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081535.260850:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081536.284686:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081537.308816:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081537.372768:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c50b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821256192:0@lo:13: 00000100:00100000:3.0:1789081537.372999:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081537.373109:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821256192 00000100:00100000:3.0:1789081537.373121:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821256192 00000100:00100000:3.0:1789081537.373196:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789081537.373210:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821256192:12345-0@lo:13: 00002000:00000024:3.0:1789081537.373270:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789081537.373329:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821256192:12345-0@lo:13: Request processed in 121us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081537.373338:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1789081537.373366:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789081537.373408:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10c50b9c00 x1875987821256192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081553 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789081537.373434:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c50b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821256192:0@lo:13: 00000100:00100000:1.0:1789081537.885210:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875987821256448:0@lo:400: 00000100:00100000:1.0:1789081537.885293:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081537.885370:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789081537.885377:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101c31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821256320:0@lo:400: 00000100:00100000:1.0:1789081537.885410:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081537.885433:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821256832:0@lo:400: 00000100:00100000:1.0:1789081537.885476:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081537.885517:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101c31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875987821256576:0@lo:400: 00000100:00100000:1.0:1789081537.885565:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081537.885583:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789081537.885587:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101c30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875987821256704:0@lo:400: 00000100:00100000:1.0:1789081537.889595:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081537.889713:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821256448 00000100:00100000:1.0:1789081537.889726:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821256448 00000100:00100000:1.0:1789081537.889790:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821256576 00000100:00100000:1.0:1789081537.890765:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821256576 00000100:00100000:3.0:1789081537.891077:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789081537.891104:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c50b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821256960:0@lo:13: 00000100:00100000:3.0:1789081537.891170:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081537.891281:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821256960 00000100:00100000:2.0:1789081537.891293:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821256960 00000100:00100000:1.0:1789081537.891456:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821256704 00000100:00100000:1.0:1789081537.891464:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821256704 00000100:00100000:2.0:1789081537.891479:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789081537.891508:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789081537.891511:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875987821256960:12345-0@lo:13: 00000100:00100000:1.0:1789081537.891555:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101c30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875987821256448:12345-0@lo:400: 00000100:00100000:1.0:1789081537.891631:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101c30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875987821256448:12345-0@lo:400: Request processed in 112us (6338us total) trans 0 rc 0/0 00002000:00000024:2.0:1789081537.892113:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789081537.892171:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875987821256960:12345-0@lo:13: Request processed in 681us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081537.892181:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789081537.892862:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789081537.892901:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789081537.892912:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11006a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875987821256576:12345-0@lo:400: 00000100:00100000:1.0:1789081537.892972:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11006a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875987821256576:12345-0@lo:400: Request processed in 63us (7406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081537.892989:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789081537.893003:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789081537.893010:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11006a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875987821256704:12345-0@lo:400: 00000100:00100000:1.0:1789081537.893042:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11006a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875987821256704:12345-0@lo:400: Request processed in 33us (3458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081537.893047:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789081537.893071:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821256320 00000100:00100000:1.0:1789081537.893078:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821256320 00000100:00100000:1.0:1789081537.893113:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789081537.893119:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3306:x1875987821256320:12345-0@lo:400: 00000100:00100000:1.0:1789081537.893151:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3306:x1875987821256320:12345-0@lo:400: Request processed in 33us (7740us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081537.893156:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789081537.893190:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821256832 00000100:00100000:1.0:1789081537.893194:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821256832 00000100:00100000:1.0:1789081537.893223:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789081537.893229:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11006a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1875987821256832:12345-0@lo:400: 00000100:00100000:1.0:1789081537.893260:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11006a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1875987821256832:12345-0@lo:400: Request processed in 31us (7783us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081537.893266:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1789081537.893296:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789081537.893301:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789081537.893367:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101c31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821256320:0@lo:400: 00010000:00080000:1.0:1789081537.893385:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e1101c30a80 x1875987821256832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789081553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789081537.893400:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821256832:0@lo:400: 00010000:00080000:1.0:1789081537.893425:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e1101c33800 x1875987821256448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789081553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789081537.893434:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875987821256448:0@lo:400: 00010000:00080000:2.0:1789081537.894754:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e1101c30380 x1875987821256704/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789081553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789081537.894772:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101c30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875987821256704:0@lo:400: 00010000:00080000:2.0:1789081537.894788:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e1101c31880 x1875987821256576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789081553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789081537.894797:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101c31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875987821256576:0@lo:400: 00010000:00080000:2.0:1789081537.896486:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10c50b9c00 x1875987821256960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081553 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789081537.896544:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c50b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821256960:0@lo:13: 00000001:00080000:1.0:1789081538.065268:0:7493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1789081538.347316:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789081538.928749:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081538.928792:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796066432 00000100:00100000:0.0:1789081538.928805:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796066432 00000100:00100000:0.0:1789081538.928848:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 113 00000100:00100000:0.0:1789081538.928885:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ffa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2347:x1875987796066432:12345-192.168.201.17@tcp:250: 00010000:00080000:0.0:1789081538.928919:0:5783:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc@192.168.201.17@tcp t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:0.0:1789081538.928952:0:5783:0:(genops.c:1406:class_connect()) connect: client 33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc, cookie 0xb7cb3d7479d5f6da 00000100:00080000:0.0:1789081538.929091:0:5783:0:(import.c:65:import_set_state_nolock()) ffff9e10ff75e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789081538.929169:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ffa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+5:2347:x1875987796066432:12345-192.168.201.17@tcp:250: Request processed in 283us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081538.929178:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 113 00000100:00100000:1.0:1789081538.946156:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081538.946797:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796066560 00000100:00100000:3.0:1789081538.946813:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796066560 00000100:00100000:3.0:1789081538.946878:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 114 00000100:00100000:3.0:1789081538.946889:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+5:5555:x1875987796066560:12345-192.168.201.17@tcp:101: 00010000:00010000:3.0:1789081538.946911:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081538.946935:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e1101999e00/0xb7cb3d7479d5f6e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a723 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081538.946971:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e1101999e00/0xb7cb3d7479d5f6e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a723 expref: 6 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081538.946984:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e1101999e00/0xb7cb3d7479d5f6e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a723 expref: 6 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081538.946995:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101999e00, rc 0) 00000100:00100000:3.0:1789081538.947065:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+6:5555:x1875987796066560:12345-192.168.201.17@tcp:101: Request processed in 178us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081538.947089:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 114 00000100:00100000:0.0:1789081538.952749:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081538.955931:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796066688 00000100:00100000:3.0:1789081538.955951:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796066688 00000100:00100000:3.0:1789081538.956018:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 115 00000100:00100000:3.0:1789081538.956029:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+6:5555:x1875987796066688:12345-192.168.201.17@tcp:501: 00000100:00100000:3.0:1789081538.956475:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+6:5555:x1875987796066688:12345-192.168.201.17@tcp:501: Request processed in 445us (3736us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789081538.956495:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 115 00000100:00100000:3.0:1789081538.964927:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081538.965127:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796066816 00000100:00100000:1.0:1789081538.965142:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796066816 00000100:00100000:1.0:1789081538.965211:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 116 00000100:00100000:1.0:1789081538.965223:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+6:5555:x1875987796066816:12345-192.168.201.17@tcp:101: 00010000:00010000:1.0:1789081538.965248:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081538.965272:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10e13af800/0xb7cb3d7479d5f6e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a72a expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081538.965321:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10e13af800/0xb7cb3d7479d5f6e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a72a expref: 7 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081538.965336:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10e13af800/0xb7cb3d7479d5f6e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a72a expref: 7 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081538.965347:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13af800, rc 0) 00000100:00100000:1.0:1789081538.965411:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+7:5555:x1875987796066816:12345-192.168.201.17@tcp:101: Request processed in 190us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081538.965432:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 116 00000100:00100000:3.0:1789081538.969045:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081538.969126:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796066944 00000100:00100000:0.0:1789081538.969139:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796066944 00000100:00100000:0.0:1789081538.969196:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 117 00000100:00100000:0.0:1789081538.969206:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+7:5555:x1875987796066944:12345-192.168.201.17@tcp:501: 00000100:00100000:3.0:1789081538.969919:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+8:5555:x1875987796066944:12345-192.168.201.17@tcp:501: Request processed in 711us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081538.969930:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 117 00000100:00100000:1.0:1789081538.976745:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081538.976830:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796067072 00000100:00100000:3.0:1789081538.976847:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796067072 00000100:00100000:3.0:1789081538.976922:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 118 00000100:00100000:3.0:1789081538.976934:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+8:5555:x1875987796067072:12345-192.168.201.17@tcp:503: 00000100:00100000:3.0:1789081538.977396:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+8:5555:x1875987796067072:12345-192.168.201.17@tcp:503: Request processed in 462us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081538.977407:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 118 00000100:00100000:0.0:1789081539.004880:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081539.004949:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796067200 00000100:00100000:0.0:1789081539.005225:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796067200 00000100:00100000:0.0:1789081539.005350:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 119 00000100:00100000:0.0:1789081539.005378:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ffb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+8:5573:x1875987796067200:12345-192.168.201.17@tcp:502: 00000100:00100000:0.0:1789081539.006119:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ffb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+8:5573:x1875987796067200:12345-192.168.201.17@tcp:502: Request processed in 742us (3212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081539.006130:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 119 00000100:00100000:3.0:1789081539.053215:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081539.053865:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796067328 00000100:00100000:2.0:1789081539.053879:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796067328 00000100:00100000:2.0:1789081539.053948:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 120 00000100:00100000:2.0:1789081539.053958:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+8:5573:x1875987796067328:12345-192.168.201.17@tcp:502: 00000100:00100000:2.0:1789081539.054248:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+8:5573:x1875987796067328:12345-192.168.201.17@tcp:502: Request processed in 291us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081539.054257:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 120 00000100:00100000:1.0:1789081539.061425:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081539.061597:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796067456 00000100:00100000:0.0:1789081539.061609:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796067456 00000100:00100000:0.0:1789081539.061673:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 121 00000100:00100000:0.0:1789081539.061682:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+8:5555:x1875987796067456:12345-192.168.201.17@tcp:101: 00010000:00010000:0.0:1789081539.061700:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081539.061742:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10c1487a00/0xb7cb3d7479d5f6ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a754 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081539.061776:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10c1487a00/0xb7cb3d7479d5f6ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a754 expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081539.061789:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10c1487a00/0xb7cb3d7479d5f6ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a754 expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081539.061798:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10c1487a00, rc 0) 00000100:00100000:0.0:1789081539.061990:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+9:5555:x1875987796067456:12345-192.168.201.17@tcp:101: Request processed in 308us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081539.061998:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 121 00000100:00100000:0.0:1789081539.080496:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081539.080682:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796067584 00000100:00100000:3.0:1789081539.080694:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796067584 00000100:00100000:3.0:1789081539.080795:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 122 00000100:00100000:3.0:1789081539.080806:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ff8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+9:5555:x1875987796067584:12345-192.168.201.17@tcp:256: 20000000:01000000:3.0:1789081539.080862:0:5783:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789081539.080884:0:5783:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789081539.080889:0:5783:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789081539.080892:0:5783:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789081539.080894:0:5783:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1789081539.086177:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ff8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+9:5555:x1875987796067584:12345-192.168.201.17@tcp:256: Request processed in 5359us (5691us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081539.086193:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 122 00000100:00100000:1.0:1789081539.094513:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081539.095349:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796067712 00000100:00100000:3.0:1789081539.095362:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796067712 00000100:00100000:3.0:1789081539.095425:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 123 00000100:00100000:3.0:1789081539.095435:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ff9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+9:5555:x1875987796067712:12345-192.168.201.17@tcp:101: 00010000:00010000:3.0:1789081539.095453:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081539.095485:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e1101998200/0xb7cb3d7479d5f6f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a75b expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081539.095516:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e1101998200/0xb7cb3d7479d5f6f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a75b expref: 10 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081539.095543:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e1101998200/0xb7cb3d7479d5f6f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a75b expref: 10 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081539.095553:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101998200, rc 0) 00000100:00100000:3.0:1789081539.095620:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ff9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:5555:x1875987796067712:12345-192.168.201.17@tcp:101: Request processed in 186us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081539.095627:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 123 00000100:00100000:0.0:1789081539.107220:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081539.111806:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796067840 00000100:00100000:1.0:1789081539.111825:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796067840 00000100:00100000:1.0:1789081539.112195:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 124 00000100:00100000:1.0:1789081539.112207:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ffac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:5555:x1875987796067840:12345-192.168.201.17@tcp:501: 00000100:00100000:1.0:1789081539.112556:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ffac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:5555:x1875987796067840:12345-192.168.201.17@tcp:501: Request processed in 350us (5347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081539.112565:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 124 00000100:00100000:0.0:1789081539.115331:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081539.115440:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796067968 00000100:00100000:3.0:1789081539.115451:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796067968 00000100:00100000:3.0:1789081539.115546:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 125 00000100:00100000:3.0:1789081539.115555:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:5555:x1875987796067968:12345-192.168.201.17@tcp:503: 00000100:00100000:3.0:1789081539.115955:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:5555:x1875987796067968:12345-192.168.201.17@tcp:503: Request processed in 399us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081539.115963:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 125 00000100:00100000:0.0:1789081539.125222:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081539.125356:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796068096 00000100:00100000:3.0:1789081539.125368:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796068096 00000100:00100000:3.0:1789081539.125428:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 126 00000100:00100000:3.0:1789081539.125437:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:5577:x1875987796068096:12345-192.168.201.17@tcp:502: 00000100:00100000:3.0:1789081539.126012:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:5577:x1875987796068096:12345-192.168.201.17@tcp:502: Request processed in 573us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081539.126020:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 126 00000100:00100000:2.0:1789081539.131241:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081539.131458:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796068224 00000100:00100000:1.0:1789081539.131469:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796068224 00000100:00100000:1.0:1789081539.131557:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 127 00000100:00100000:1.0:1789081539.131567:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:5577:x1875987796068224:12345-192.168.201.17@tcp:502: 00000100:00100000:1.0:1789081539.132018:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:5577:x1875987796068224:12345-192.168.201.17@tcp:502: Request processed in 452us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081539.132026:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 127 00000100:00100000:1.0:1789081539.134816:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081539.134900:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796068352 00000100:00100000:2.0:1789081539.134911:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796068352 00000100:00100000:2.0:1789081539.134958:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 4 00000100:00100000:2.0:1789081539.134966:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11006a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2347:x1875987796068352:12345-192.168.201.17@tcp:38: 00010000:00080000:2.0:1789081539.135001:0:5790:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 41476931-e751-413e-b98c-64d4d0edcd05@192.168.201.17@tcp t0 exp 0000000000000000 cur 206 last 0 00000020:00000080:2.0:1789081539.135057:0:5790:0:(genops.c:1406:class_connect()) connect: client 41476931-e751-413e-b98c-64d4d0edcd05, cookie 0xb7cb3d7479d5f6fd 00000004:00100000:2.0:1789081539.135088:0:5790:0:(mdt_handler.c:7402:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1789081539.135111:0:5790:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1789081539.192904:0:5790:0:(import.c:65:import_set_state_nolock()) ffff9e0fc3a1a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789081539.193738:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11006a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+6:2347:x1875987796068352:12345-192.168.201.17@tcp:38: Request processed in 58763us (58925us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081539.193753:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 4 00010000:00010000:0.0:1789081539.356866:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789081540.199271:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081540.199309:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081540.199383:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796068480 00000100:00100000:1.0:1789081540.199393:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796068480 00000100:00100000:1.0:1789081540.199475:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796068608 00000100:00100000:1.0:1789081540.199480:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796068608 00000100:00100000:1.0:1789081540.199503:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 5 00000100:00100000:1.0:1789081540.199511:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+7:0:x1875987796068480:12345-192.168.201.17@tcp:41: 00000100:00100000:2.0:1789081540.199580:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 6 00000004:00000024:1.0:1789081540.199588:0:5789:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789081540.199595:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+7:5555:x1875987796068608:12345-192.168.201.17@tcp:41: 00000004:00000024:2.0:1789081540.199615:0:5790:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789081540.199653:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+7:0:x1875987796068480:12345-192.168.201.17@tcp:41: Request processed in 142us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081540.199656:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+7:5555:x1875987796068608:12345-192.168.201.17@tcp:41: Request processed in 65us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081540.199663:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 5 00000100:00100000:2.0:1789081540.199670:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 6 00000100:00080000:0.0:1789081540.200095:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789081540.201299:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081540.201400:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796068736 00000100:00100000:1.0:1789081540.201408:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796068736 00000100:00100000:1.0:1789081540.201492:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 7 00000100:00100000:1.0:1789081540.201501:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+6:5555:x1875987796068736:12345-192.168.201.17@tcp:40: 00000100:00100000:1.0:1789081540.201602:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+6:5555:x1875987796068736:12345-192.168.201.17@tcp:40: Request processed in 102us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081540.201610:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 7 00000100:00100000:1.0:1789081540.212414:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081540.212521:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796069120 00000100:00100000:3.0:1789081540.212560:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796069120 00000100:00100000:3.0:1789081540.212663:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 0 00000100:00100000:3.0:1789081540.212675:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11006a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+6:5555:x1875987796069120:12345-192.168.201.17@tcp:33: 00000100:00100000:1.0:1789081540.212839:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081540.212868:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081540.212891:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081540.212913:0:7788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796068864 00000100:00100000:1.0:1789081540.212917:0:7788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796068864 00000100:00100000:1.0:1789081540.212939:0:7788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796068992 00000100:00100000:1.0:1789081540.212942:0:7788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796068992 00000100:00100000:1.0:1789081540.212958:0:7788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 8 00000100:00100000:1.0:1789081540.212963:0:7788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11006a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2347:x1875987796068864:12345-192.168.201.17@tcp:8: 00010000:00080000:1.0:1789081540.212989:0:7788:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 41476931-e751-413e-b98c-64d4d0edcd05@192.168.201.17@tcp t0 exp 0000000000000000 cur 207 last 0 00000020:00000080:1.0:1789081540.213022:0:7788:0:(genops.c:1406:class_connect()) connect: client 41476931-e751-413e-b98c-64d4d0edcd05, cookie 0xb7cb3d7479d5f704 00002000:00100000:1.0:1789081540.213035:0:7788:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 41476931-e751-413e-b98c-64d4d0edcd05/ffff9e110161f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113719 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789081540.213061:0:7788:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789081540.213942:0:7788:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789081540.213984:0:7788:0:(import.c:65:import_set_state_nolock()) ffff9e110161e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789081540.214066:0:7788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11006a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41476931-e751-413e-b98c-64d4d0edcd05+6:2347:x1875987796068864:12345-192.168.201.17@tcp:8: Request processed in 1100us (1196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081540.214075:0:7788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 8 00000100:00100000:1.0:1789081540.214106:0:7788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 9 00000100:00100000:1.0:1789081540.214111:0:7788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11006a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2347:x1875987796068992:12345-192.168.201.17@tcp:8: 00010000:00080000:1.0:1789081540.214150:0:7788:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 41476931-e751-413e-b98c-64d4d0edcd05@192.168.201.17@tcp t0 exp 0000000000000000 cur 207 last 0 00000020:00000080:1.0:1789081540.214173:0:7788:0:(genops.c:1406:class_connect()) connect: client 41476931-e751-413e-b98c-64d4d0edcd05, cookie 0xb7cb3d7479d5f70b 00002000:00100000:1.0:1789081540.214182:0:7788:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 41476931-e751-413e-b98c-64d4d0edcd05/ffff9e110161c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113719 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789081540.214203:0:7788:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:3.0:1789081540.215614:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796069248 00000100:00100000:3.0:1789081540.215626:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796069248 00000100:00100000:3.0:1789081540.215683:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 128 00000100:00100000:3.0:1789081540.215691:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:2349:x1875987796069248:12345-192.168.201.17@tcp:400: 00000100:00100000:3.0:1789081540.215797:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:2349:x1875987796069248:12345-192.168.201.17@tcp:400: Request processed in 108us (2959us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081540.215803:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 128 00002000:00080000:1.0:1789081540.216043:0:7788:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789081540.216079:0:7788:0:(import.c:65:import_set_state_nolock()) ffff9e1101618000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789081540.216118:0:7788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11006a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41476931-e751-413e-b98c-64d4d0edcd05+6:2347:x1875987796068992:12345-192.168.201.17@tcp:8: Request processed in 2006us (3227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081540.216125:0:7788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 9 00000004:00080000:3.0:1789081540.256237:0:5792:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 43477us 00000004:00200000:3.0:1789081540.277726:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1789081540.277938:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11006a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+6:5555:x1875987796069120:12345-192.168.201.17@tcp:33: Request processed in 65257us (65532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081540.277951:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 0 00010000:00010000:1.0:1789081540.382589:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789081540.563886:0:6607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 41476931-e751-413e-b98c-64d4d0edcd05 00000100:00100000:3.0:1789081540.649247:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081540.649399:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796069376 00000100:00100000:2.0:1789081540.649423:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796069376 00000100:00100000:2.0:1789081540.649828:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 8 00000100:00100000:2.0:1789081540.649849:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+6:5594:x1875987796069376:12345-192.168.201.17@tcp:101: 00010000:00010000:2.0:1789081540.649886:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081540.650296:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0000/0xb7cb3d7479d5f712 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a785 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081540.650423:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d5f719 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081540.650444:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d5f719 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081540.650478:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d5f719 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789081540.651087:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1789081540.651100:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1789081540.653840:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d5f719 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081540.653944:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0000/0xb7cb3d7479d5f712 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a785 expref: 8 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081540.653979:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d5f719 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a785 expref: 7 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081540.653991:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c9a92000) 00010000:00010000:2.0:1789081540.653995:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789081540.654000:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10c29e0c00, rc 0) 00000100:00100000:2.0:1789081540.654140:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+7:5594:x1875987796069376:12345-192.168.201.17@tcp:101: Request processed in 4295us (4903us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081540.654152:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 8 00010000:00010000:0.0:1789081541.408600:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081542.429261:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789081542.492888:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789081542.492923:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821257088:0@lo:13: 00000100:00100000:1.0:1789081542.493023:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081542.494356:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821257088 00000100:00100000:2.0:1789081542.494372:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821257088 00000100:00100000:2.0:1789081542.494475:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789081542.494486:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11006a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821257088:12345-0@lo:13: 00002000:00000024:2.0:1789081542.494580:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789081542.495162:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789081542.499694:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11006a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821257088:12345-0@lo:13: Request processed in 5198us (6659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081542.499720:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1789081542.500052:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10f5c79880 x1875987821257088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081558 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789081542.503642:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821257088:0@lo:13: 00000100:00100000:3.0:1789081542.892639:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081542.894762:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796069504 00000100:00100000:1.0:1789081542.894783:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796069504 00000100:00100000:1.0:1789081542.894956:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 9 00000100:00100000:1.0:1789081542.894970:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+7:5646:x1875987796069504:12345-192.168.201.17@tcp:41: 00000004:00000024:1.0:1789081542.895027:0:5789:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789081542.895129:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+7:5646:x1875987796069504:12345-192.168.201.17@tcp:41: Request processed in 163us (2502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081542.895168:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 9 00000100:00080000:0.0:1789081542.899651:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789081542.904954:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081542.905145:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796069632 00000100:00100000:1.0:1789081542.905158:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796069632 00000100:00080000:0.0:1789081542.905556:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789081542.905752:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 10 00000100:00100000:1.0:1789081542.905764:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:41476931-e751-413e-b98c-64d4d0edcd05+5:5646:x1875987796069632:12345-192.168.201.17@tcp:13: 00002000:00000024:1.0:1789081542.905793:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789081542.905868:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:41476931-e751-413e-b98c-64d4d0edcd05+5:5646:x1875987796069632:12345-192.168.201.17@tcp:13: Request processed in 107us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081542.905875:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 10 00000100:00100000:3.0:1789081542.909508:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081542.909780:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796069760 00000100:00100000:2.0:1789081542.909792:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796069760 00000100:00100000:2.0:1789081542.909884:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 11 00000100:00100000:2.0:1789081542.909897:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:41476931-e751-413e-b98c-64d4d0edcd05+6:5646:x1875987796069760:12345-192.168.201.17@tcp:13: 00002000:00000024:2.0:1789081542.909946:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789081542.910154:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:41476931-e751-413e-b98c-64d4d0edcd05+6:5646:x1875987796069760:12345-192.168.201.17@tcp:13: Request processed in 132us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081542.910163:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 11 00000100:00080000:0.0:1789081542.910819:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789081543.005805:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875987821257344:0@lo:400: 00000100:00100000:2.0:1789081543.005888:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081543.005961:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789081543.005967:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1100643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875987821257472:0@lo:400: 00000100:00100000:2.0:1789081543.005988:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081543.006037:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821257344 00000100:00100000:2.0:1789081543.006045:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821257344 00000100:00100000:2.0:1789081543.006087:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821257472 00000100:00100000:2.0:1789081543.006090:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821257472 00000100:00100000:2.0:1789081543.006118:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789081543.006126:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1100640e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875987821257344:12345-0@lo:400: 00000100:00100000:2.0:1789081543.006172:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1100640e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875987821257344:12345-0@lo:400: Request processed in 47us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081543.006180:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789081543.006196:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789081543.006201:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1100643b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875987821257472:12345-0@lo:400: 00000100:00100000:2.0:1789081543.006221:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1100643b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875987821257472:12345-0@lo:400: Request processed in 21us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081543.006226:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789081543.006262:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1100643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875987821257472:0@lo:400: 00000100:00100000:2.0:1789081543.006282:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875987821257344:0@lo:400: 00000100:00100000:1.0:1789081543.006466:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821257216:0@lo:400: 00000100:00100000:1.0:1789081543.006500:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081543.006550:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1100640380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821257728:0@lo:400: 00000100:00100000:1.0:1789081543.006575:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081543.006592:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789081543.006596:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1100641880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875987821257600:0@lo:400: 00000100:00100000:1.0:1789081543.006615:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081543.008234:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821257728 00000100:00100000:3.0:1789081543.008247:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821257728 00000100:00100000:1.0:1789081543.008425:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821257856:0@lo:13: 00000100:00100000:1.0:1789081543.008487:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081543.008650:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821257216 00000100:00100000:2.0:1789081543.008655:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821257216 00000100:00100000:2.0:1789081543.008688:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789081543.008697:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3304:x1875987821257216:12345-0@lo:400: 00000100:00100000:2.0:1789081543.008753:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3304:x1875987821257216:12345-0@lo:400: Request processed in 58us (2252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081543.008761:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789081543.008810:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821257216:0@lo:400: 00000100:00100000:2.0:1789081543.008834:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821257600 00000100:00100000:2.0:1789081543.008837:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821257600 00000100:00100000:2.0:1789081543.008866:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789081543.008872:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11006a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875987821257600:12345-0@lo:400: 00000100:00100000:2.0:1789081543.008909:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11006a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875987821257600:12345-0@lo:400: Request processed in 37us (2291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081543.008916:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789081543.008946:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1100641880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875987821257600:0@lo:400: 00000100:00100000:2.0:1789081543.008967:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821257856 00000100:00100000:2.0:1789081543.008970:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821257856 00000100:00100000:2.0:1789081543.008992:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789081543.008998:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11006a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875987821257856:12345-0@lo:13: 00002000:00000024:2.0:1789081543.009017:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789081543.009066:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11006a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875987821257856:12345-0@lo:13: Request processed in 68us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081543.009073:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1789081543.009115:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10f5c78a80 x1875987821257856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081559 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789081543.009124:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789081543.009141:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821257856:0@lo:13: 00000100:00100000:3.0:1789081543.009290:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789081543.009304:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11006a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821257728:12345-0@lo:400: 00000100:00100000:3.0:1789081543.009354:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11006a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821257728:12345-0@lo:400: Request processed in 54us (2778us total) trans 0 rc 0/0 00010000:00080000:2.0:1789081543.009414:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e1100640380 x1875987821257728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789081559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789081543.009424:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1100640380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821257728:0@lo:400: 00000100:00080000:0.0:1789081543.009926:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789081543.009934:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789081543.015466:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1789081543.452724:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081544.487597:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789081544.608581:0:5811:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 41476931-e751-413e-b98c-64d4d0edcd05 00000001:00100000:2.0:1789081544.611252:0:7493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 41476931-e751-413e-b98c-64d4d0edcd05 00010000:00010000:0.0:1789081545.505396:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081545.687995:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081545.688040:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081545.688082:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081545.688106:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081545.688133:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796069888 00000100:00100000:3.0:1789081545.688144:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796069888 00000100:00100000:3.0:1789081545.688201:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 130 00000100:00100000:3.0:1789081545.688212:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:2351:x1875987796069888:12345-192.168.201.17@tcp:400: 00000100:00100000:2.0:1789081545.688278:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796070016 00000100:00100000:2.0:1789081545.688283:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796070016 00000100:00100000:3.0:1789081545.688284:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:2351:x1875987796069888:12345-192.168.201.17@tcp:400: Request processed in 74us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081545.688292:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 130 00000100:00100000:2.0:1789081545.688323:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 25 00000100:00100000:2.0:1789081545.688329:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+6:2351:x1875987796070016:12345-192.168.201.17@tcp:400: 00000100:00100000:3.0:1789081545.688343:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796070272 00000100:00100000:3.0:1789081545.688346:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796070272 00000100:00100000:2.0:1789081545.688374:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+6:2351:x1875987796070016:12345-192.168.201.17@tcp:400: Request processed in 44us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081545.688380:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 25 00000100:00100000:3.0:1789081545.688381:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796070144 00000100:00100000:3.0:1789081545.688384:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796070144 00000100:00080000:2.0:1789081545.688400:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789081545.688403:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 7 00000100:00080000:2.0:1789081545.688404:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789081545.688406:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789081545.688408:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+5:2351:x1875987796070272:12345-192.168.201.17@tcp:400: 00000100:00100000:3.0:1789081545.688433:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+5:2351:x1875987796070272:12345-192.168.201.17@tcp:400: Request processed in 25us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081545.688439:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 7 00000100:00100000:3.0:1789081545.688450:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 8 00000100:00100000:3.0:1789081545.688454:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+5:2351:x1875987796070144:12345-192.168.201.17@tcp:400: 00000100:00100000:3.0:1789081545.688477:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+5:2351:x1875987796070144:12345-192.168.201.17@tcp:400: Request processed in 21us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081545.688483:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 8 00000001:02000400:1.0:1789081546.028124:0:8153:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789081546.524809:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081547.556841:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789081547.612802:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821257984:0@lo:13: 00000100:00100000:2.0:1789081547.612909:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081547.613143:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821257984 00000100:00100000:1.0:1789081547.613154:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821257984 00000100:00100000:1.0:1789081547.613248:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789081547.613259:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1100640380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821257984:12345-0@lo:13: 00002000:00000024:1.0:1789081547.613313:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789081547.613377:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1100640380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821257984:12345-0@lo:13: Request processed in 120us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081547.613385:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1789081547.613437:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e11006a7100 x1875987821257984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081563 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789081547.613458:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821257984:0@lo:13: 00000100:00080000:2.0:1789081547.613662:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789081548.130953:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1100641880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee551687-7675-4fc6-9be1-2ccb62bdd809:3303:1875987821258112:0@lo:400: 00000100:00100000:2.0:1789081548.131050:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081548.131114:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1100641500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875987821258624:0@lo:400: 00000100:00100000:2.0:1789081548.131144:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081548.131186:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789081548.131193:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1100643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875987821258240:0@lo:400: 00000100:00100000:2.0:1789081548.131218:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081548.131235:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1100643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821258752:0@lo:400: 00000100:00100000:2.0:1789081548.131263:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081548.131294:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1100640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875987821258368:0@lo:400: 00000100:00100000:2.0:1789081548.131329:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081548.131351:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789081548.131356:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1100640700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821258496:0@lo:400: 00000100:00100000:2.0:1789081548.131381:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081548.131418:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821258112 00000100:00100000:2.0:1789081548.131428:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821258112 00000100:00100000:2.0:1789081548.131491:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789081548.131500:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3303:x1875987821258112:12345-0@lo:400: 00000100:00100000:2.0:1789081548.131592:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3303:x1875987821258112:12345-0@lo:400: Request processed in 92us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081548.131601:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789081548.131639:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821258624 00000100:00100000:2.0:1789081548.131644:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821258624 00000100:00100000:2.0:1789081548.131680:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821258240 00000100:00100000:2.0:1789081548.131683:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821258240 00000100:00100000:2.0:1789081548.131697:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821258368 00000100:00100000:2.0:1789081548.131700:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821258368 00000100:00100000:2.0:1789081548.131715:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789081548.131722:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1100642300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875987821258624:12345-0@lo:400: 00000100:00100000:2.0:1789081548.131756:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1100642300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875987821258624:12345-0@lo:400: Request processed in 34us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081548.131763:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789081548.131784:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789081548.131790:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1100641c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875987821258240:12345-0@lo:400: 00000100:00100000:2.0:1789081548.131821:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1100641c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875987821258240:12345-0@lo:400: Request processed in 31us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081548.131827:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789081548.131839:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789081548.131846:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1100642a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875987821258368:12345-0@lo:400: 00000100:00100000:2.0:1789081548.131877:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1100642a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875987821258368:12345-0@lo:400: Request processed in 33us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081548.131883:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789081548.131906:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821258752 00000100:00100000:2.0:1789081548.131910:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821258752 00000100:00100000:2.0:1789081548.131939:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821258496 00000100:00100000:2.0:1789081548.131942:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821258496 00000100:00100000:2.0:1789081548.131963:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789081548.131969:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1100640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821258752:12345-0@lo:400: 00000100:00100000:2.0:1789081548.132000:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1100640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821258752:12345-0@lo:400: Request processed in 32us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081548.132007:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789081548.132018:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789081548.132023:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1100642d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821258496:12345-0@lo:400: 00000100:00100000:2.0:1789081548.132050:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1100642d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821258496:12345-0@lo:400: Request processed in 27us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081548.132056:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1789081548.132086:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789081548.132091:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789081548.132139:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e1100640700 x1875987821258496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789081564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789081548.132165:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1100640700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821258496:0@lo:400: 00000100:00100000:2.0:1789081548.132179:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1100640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875987821258368:0@lo:400: 00000100:00100000:2.0:1789081548.132213:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1100643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875987821258240:0@lo:400: 00010000:00080000:2.0:1789081548.132224:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e1100643480 x1875987821258752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789081564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789081548.132232:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1100643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821258752:0@lo:400: 00000100:00100000:2.0:1789081548.132242:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1100641880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee551687-7675-4fc6-9be1-2ccb62bdd809:3303:1875987821258112:0@lo:400: 00000100:00100000:2.0:1789081548.132250:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1100641500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875987821258624:0@lo:400: 00000100:00100000:2.0:1789081548.132799:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789081548.132812:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821258880:0@lo:13: 00000100:00100000:2.0:1789081548.132854:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081548.132935:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821258880 00000100:00100000:0.0:1789081548.132941:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821258880 00000100:00100000:0.0:1789081548.132985:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789081548.132993:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1100641500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821258880:12345-0@lo:13: 00002000:00000024:0.0:1789081548.133029:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789081548.133074:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1100641500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821258880:12345-0@lo:13: Request processed in 82us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081548.133082:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1789081548.133146:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e11010b4000 x1875987821258880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081564 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789081548.133162:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821258880:0@lo:13: 00010000:00010000:3.0:1789081548.577652:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081549.596806:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081550.621021:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789081550.706809:0:8301:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea6e20d30 20000000:00000080:3.0:1789081550.706829:0:8301:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e10f5f02400 uarg=0000000000000000 20000000:01000000:3.0:1789081550.707119:0:8301:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1789081550.707122:0:8301:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1789081550.707125:0:8301:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789081550.707131:0:8301:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789081550.707136:0:8301:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1789081550.707215:0:8301:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789081550.707219:0:8301:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789081550.707873:0:8301:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789081550.707877:0:8301:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789081550.710309:0:8302:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1789081550.711285:0:8301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1789081550.711340:0:8301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1789081550.711397:0:8301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1789081550.711412:0:8301:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789081550.711414:0:8301:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789081550.712354:0:8303:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1789081550.713119:0:8301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1789081550.713242:0:8301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1789081550.713289:0:8301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1789081550.713306:0:8301:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789081550.713309:0:8301:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789081550.714848:0:8304:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1789081550.715733:0:8301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1789081550.715801:0:8301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1789081550.715840:0:8301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1789081550.715853:0:8301:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789081550.715856:0:8301:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789081550.717142:0:8305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1789081550.717852:0:8301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1789081550.718026:0:8301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1789081550.718079:0:8301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:3.0:1789081550.718098:0:8301:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789081550.718118:0:8301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e1101999c00/0xb7cb3d7479d5f720 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081550.718140:0:8301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e10c0030000/0xb7cb3d7479d5f61d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f616 expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081550.718159:0:8301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e10c0031600/0xb7cb3d7479d5f647 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f640 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081550.718165:0:8301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e10e13ae600/0xb7cb3d7479d5f671 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f66a expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081550.718172:0:8301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e10c29e1000/0xb7cb3d7479d5f67f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f678 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081550.718179:0:8301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e10e13afc00/0xb7cb3d7479d5f68d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f686 expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081550.718184:0:8301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e10e13af400/0xb7cb3d7479d5f6a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f6a2 expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081550.718191:0:8301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e10e13aea00/0xb7cb3d7479d5f6d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f6cc expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081550.718202:0:8301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e1101999e00/0xb7cb3d7479d5f6e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a723 expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081550.718211:0:8301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e10e13af800/0xb7cb3d7479d5f6e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a72a expref: 9 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081550.718230:0:8301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e1101999c00/0xb7cb3d7479d5f720 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081550.718279:0:8301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e10e13af800/0xb7cb3d7479d5f6e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a72a expref: 9 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081550.718295:0:8301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e10e13af800/0xb7cb3d7479d5f6e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a72a expref: 9 pid: 5783 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081550.718310:0:8301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c7a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8301:1875987821259008:192.168.201.17@tcp:104: 00010000:00010000:3.0:1789081550.718433:0:8301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e1101999e00/0xb7cb3d7479d5f6e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a723 expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081550.718442:0:8301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e1101999e00/0xb7cb3d7479d5f6e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a723 expref: 9 pid: 5784 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081550.718452:0:8301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c79c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8301:1875987821259136:192.168.201.17@tcp:104: 00010000:00010000:3.0:1789081550.718479:0:8301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e10e13aea00/0xb7cb3d7479d5f6d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb7cb3d7479d5f6cc expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081550.718487:0:8301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e10e13aea00/0xb7cb3d7479d5f6d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f6cc expref: 18 pid: 5783 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081550.718496:0:8301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c78000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8301:1875987821259264:0@lo:104: 00000100:00100000:3.0:1789081550.718581:0:8301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789081550.718616:0:8301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e10e13af400/0xb7cb3d7479d5f6a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb7cb3d7479d5f6a2 expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081550.718634:0:8301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e10e13af400/0xb7cb3d7479d5f6a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f6a2 expref: 18 pid: 5782 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081550.718643:0:8301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c7aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8301:1875987821259392:0@lo:104: 00010000:00010000:3.0:1789081550.718671:0:8301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e10e13afc00/0xb7cb3d7479d5f68d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb7cb3d7479d5f686 expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081550.718679:0:8301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e10e13afc00/0xb7cb3d7479d5f68d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f686 expref: 18 pid: 5782 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081550.718687:0:8301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c7ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8301:1875987821259520:0@lo:104: 00010000:00010000:3.0:1789081550.718705:0:8301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e10c29e1000/0xb7cb3d7479d5f67f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb7cb3d7479d5f678 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081550.718713:0:8301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e10c29e1000/0xb7cb3d7479d5f67f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f678 expref: 18 pid: 5784 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081550.718721:0:8301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c79f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8301:1875987821259648:0@lo:104: 00010000:00010000:3.0:1789081550.718744:0:8301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e10e13ae600/0xb7cb3d7479d5f671 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb7cb3d7479d5f66a expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081550.718751:0:8301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e10e13ae600/0xb7cb3d7479d5f671 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f66a expref: 18 pid: 5782 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081550.718759:0:8301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c7a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8301:1875987821259776:0@lo:104: 00010000:00010000:3.0:1789081550.718777:0:8301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e10c0031600/0xb7cb3d7479d5f647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb7cb3d7479d5f640 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081550.718795:0:8301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e10c0031600/0xb7cb3d7479d5f647 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f640 expref: 18 pid: 5783 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081550.718804:0:8301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c79180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8301:1875987821259904:0@lo:104: 00010000:00010000:3.0:1789081550.718829:0:8301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e10c0030000/0xb7cb3d7479d5f61d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb7cb3d7479d5f616 expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081550.718838:0:8301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e10c0030000/0xb7cb3d7479d5f61d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f616 expref: 18 pid: 5782 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081550.718844:0:8301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c7b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8301:1875987821260032:0@lo:104: 00000100:00100000:3.0:1789081550.718859:0:8301:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c8e83480 going to sleep for 11 seconds 00000100:00100000:0.0:1789081550.719169:0:5773:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789081550.719188:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081550.719215:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081550.719226:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081550.719247:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081550.719257:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081550.719265:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081550.719289:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821259264 00000100:00100000:0.0:1789081550.719296:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821259264 00000100:00100000:0.0:1789081550.719330:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821259392 00000100:00100000:0.0:1789081550.719333:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821259392 00000100:00100000:0.0:1789081550.719342:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821259520 00000100:00100000:0.0:1789081550.719348:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821259520 00000100:00100000:0.0:1789081550.719359:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821259648 00000100:00100000:0.0:1789081550.719361:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821259648 00000100:00100000:0.0:1789081550.719371:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821259776 00000100:00100000:0.0:1789081550.719373:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821259776 00000100:00100000:0.0:1789081550.719383:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821259904 00000100:00100000:0.0:1789081550.719385:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821259904 00000100:00100000:0.0:1789081550.719394:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821260032 00000100:00100000:0.0:1789081550.719396:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821260032 00000100:00100000:0.0:1789081550.719407:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789081550.719413:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ffbc0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+9:8301:x1875987821259264:12345-0@lo:104: 00010000:00010000:0.0:1789081550.719425:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1e00/0xb7cb3d7479d5f6cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f6d3 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.719479:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789081550.719485:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ffbc0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+9:8301:x1875987821259264:12345-0@lo:104: Request processed in 72us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081550.719492:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789081550.719541:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789081550.719548:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+8:8301:x1875987821259392:12345-0@lo:104: 00010000:00010000:0.0:1789081550.719555:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1200/0xb7cb3d7479d5f6a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f6a9 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.719599:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789081550.719605:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+8:8301:x1875987821259392:12345-0@lo:104: Request processed in 58us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081550.719611:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789081550.719623:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789081550.719628:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+7:8301:x1875987821259520:12345-0@lo:104: 00010000:00010000:0.0:1789081550.719642:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.117@tcp lock: ffff9e10e13aee00/0xb7cb3d7479d5f686 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f68d expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.719669:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789081550.719675:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+7:8301:x1875987821259520:12345-0@lo:104: Request processed in 47us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081550.719680:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789081550.719692:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789081550.719697:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+6:8301:x1875987821259648:12345-0@lo:104: 00010000:00010000:0.0:1789081550.719704:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.117@tcp lock: ffff9e10c0031400/0xb7cb3d7479d5f678 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f67f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.719726:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789081550.719731:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+6:8301:x1875987821259648:12345-0@lo:104: Request processed in 34us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081550.719736:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789081550.719748:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789081550.719753:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+5:8301:x1875987821259776:12345-0@lo:104: 00010000:00010000:0.0:1789081550.719760:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.117@tcp lock: ffff9e1101999600/0xb7cb3d7479d5f66a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f671 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.719784:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1789081550.719788:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+5:8301:x1875987821259776:12345-0@lo:104: Request processed in 36us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081550.719793:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789081550.719803:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789081550.719808:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+4:8301:x1875987821259904:12345-0@lo:104: 00010000:00010000:0.0:1789081550.719822:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.117@tcp lock: ffff9e10c0030a00/0xb7cb3d7479d5f640 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f647 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.719847:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1789081550.719852:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+4:8301:x1875987821259904:12345-0@lo:104: Request processed in 44us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081550.719858:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789081550.719869:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789081550.719873:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+3:8301:x1875987821260032:12345-0@lo:104: 00010000:00010000:0.0:1789081550.719880:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.117@tcp lock: ffff9e10e13af200/0xb7cb3d7479d5f616 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f61d expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.719903:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1789081550.719907:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+3:8301:x1875987821260032:12345-0@lo:104: Request processed in 34us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081550.719913:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:0.0:1789081550.720067:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1789081550.720074:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1e00/0xb7cb3d7479d5f6cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f6d3 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.720081:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10c29e1e00 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:0.0:1789081550.720086:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1e00/0xb7cb3d7479d5f6cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xb7cb3d7479d5f6d3 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.720095:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1e00/0xb7cb3d7479d5f6cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xb7cb3d7479d5f6d3 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789081550.720102:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1e00/0xb7cb3d7479d5f6cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xb7cb3d7479d5f6d3 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789081550.720113:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789081550.720144:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1e00/0xb7cb3d7479d5f6cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f6d3 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.720151:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789081550.720170:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1e00/0xb7cb3d7479d5f6cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f6d3 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.720176:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1e00/0xb7cb3d7479d5f6cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f6d3 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.720190:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1789081550.720194:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1200/0xb7cb3d7479d5f6a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f6a9 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.720200:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10c29e1200 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:0.0:1789081550.720203:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1200/0xb7cb3d7479d5f6a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xb7cb3d7479d5f6a9 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.720211:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1200/0xb7cb3d7479d5f6a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xb7cb3d7479d5f6a9 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789081550.720218:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1200/0xb7cb3d7479d5f6a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xb7cb3d7479d5f6a9 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789081550.720223:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789081550.720235:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1200/0xb7cb3d7479d5f6a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f6a9 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.720240:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789081550.720258:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1200/0xb7cb3d7479d5f6a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f6a9 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.720265:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1200/0xb7cb3d7479d5f6a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f6a9 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.720288:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789081550.720291:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e10e13aee00/0xb7cb3d7479d5f686 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f68d expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.720297:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13aee00 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:0.0:1789081550.720300:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e10e13aee00/0xb7cb3d7479d5f686 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb7cb3d7479d5f68d expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.720307:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e10e13aee00/0xb7cb3d7479d5f686 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb7cb3d7479d5f68d expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789081550.720313:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e10e13aee00/0xb7cb3d7479d5f686 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb7cb3d7479d5f68d expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789081550.720319:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789081550.720331:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e10e13aee00/0xb7cb3d7479d5f686 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f68d expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.720337:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789081550.720341:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e10e13aee00/0xb7cb3d7479d5f686 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f68d expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.720347:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e10e13aee00/0xb7cb3d7479d5f686 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f68d expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.720357:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789081550.720366:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e10c0031400/0xb7cb3d7479d5f678 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f67f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.720372:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10c0031400 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:0.0:1789081550.720375:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e10c0031400/0xb7cb3d7479d5f678 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb7cb3d7479d5f67f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.720381:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e10c0031400/0xb7cb3d7479d5f678 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb7cb3d7479d5f67f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789081550.720387:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e10c0031400/0xb7cb3d7479d5f678 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb7cb3d7479d5f67f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789081550.720393:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789081550.720405:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e10c0031400/0xb7cb3d7479d5f678 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f67f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.720409:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789081550.720414:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e10c0031400/0xb7cb3d7479d5f678 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f67f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.720421:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e10c0031400/0xb7cb3d7479d5f678 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f67f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.720431:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789081550.720434:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e1101999600/0xb7cb3d7479d5f66a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f671 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.720440:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999600 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:0.0:1789081550.720443:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e1101999600/0xb7cb3d7479d5f66a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb7cb3d7479d5f671 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.720459:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e1101999600/0xb7cb3d7479d5f66a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb7cb3d7479d5f671 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789081550.720466:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e1101999600/0xb7cb3d7479d5f66a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb7cb3d7479d5f671 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789081550.720471:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789081550.720482:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e1101999600/0xb7cb3d7479d5f66a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f671 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.720487:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789081550.720492:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e1101999600/0xb7cb3d7479d5f66a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f671 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.720498:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e1101999600/0xb7cb3d7479d5f66a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f671 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.720508:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789081550.720511:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e10c0030a00/0xb7cb3d7479d5f640 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f647 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.720517:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10c0030a00 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:0.0:1789081550.720520:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e10c0030a00/0xb7cb3d7479d5f640 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb7cb3d7479d5f647 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.720547:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e10c0030a00/0xb7cb3d7479d5f640 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb7cb3d7479d5f647 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789081550.720553:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e10c0030a00/0xb7cb3d7479d5f640 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb7cb3d7479d5f647 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789081550.720565:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789081550.720700:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e10c0030a00/0xb7cb3d7479d5f640 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f647 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.720706:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789081550.720710:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e10c0030a00/0xb7cb3d7479d5f640 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f647 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.720717:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e10c0030a00/0xb7cb3d7479d5f640 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f647 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.720727:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789081550.720730:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e10e13af200/0xb7cb3d7479d5f616 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f61d expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.720736:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13af200 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:0.0:1789081550.720738:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e10e13af200/0xb7cb3d7479d5f616 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb7cb3d7479d5f61d expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.720744:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e10e13af200/0xb7cb3d7479d5f616 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb7cb3d7479d5f61d expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789081550.720751:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e10e13af200/0xb7cb3d7479d5f616 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb7cb3d7479d5f61d expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789081550.720757:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789081550.720766:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e10e13af200/0xb7cb3d7479d5f616 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f61d expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.720771:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789081550.720781:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e10e13af200/0xb7cb3d7479d5f616 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f61d expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.720788:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e10e13af200/0xb7cb3d7479d5f616 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f61d expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.720801:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081550.720803:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081550.720805:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081550.720813:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081550.722461:0:8301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c78000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8301:1875987821259264:0@lo:104: 00000100:00100000:3.0:1789081550.722477:0:8301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c7aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8301:1875987821259392:0@lo:104: 00000100:00100000:3.0:1789081550.722486:0:8301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c7ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8301:1875987821259520:0@lo:104: 00000100:00100000:3.0:1789081550.722494:0:8301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c79f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8301:1875987821259648:0@lo:104: 00000100:00100000:3.0:1789081550.722503:0:8301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c7a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8301:1875987821259776:0@lo:104: 00000100:00100000:3.0:1789081550.722511:0:8301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c79180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8301:1875987821259904:0@lo:104: 00000100:00100000:3.0:1789081550.722519:0:8301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c7b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8301:1875987821260032:0@lo:104: 00000100:00100000:0.0:1789081550.722692:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821260544:0@lo:103: 00000100:00100000:0.0:1789081550.722748:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081550.722792:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789081550.722798:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821260160:0@lo:103: 00000100:00100000:0.0:1789081550.722819:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081550.722841:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821260672:0@lo:103: 00000100:00100000:0.0:1789081550.722857:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081550.722890:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821260544 00000100:00100000:0.0:1789081550.722896:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821260544 00010000:00010000:0.0:1789081550.722943:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e10c29e1000/0xb7cb3d7479d5f67f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f678 expref: 19 pid: 5784 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081550.722971:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821260160 00000100:00100000:0.0:1789081550.722974:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821260160 00010000:00010000:0.0:1789081550.722987:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e10e13aea00/0xb7cb3d7479d5f6d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f6cc expref: 20 pid: 5783 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081550.722998:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821260672 00000100:00100000:0.0:1789081550.723000:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821260672 00010000:00010000:0.0:1789081550.723008:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e10e13ae600/0xb7cb3d7479d5f671 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f66a expref: 21 pid: 5782 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081550.723030:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789081550.723050:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+21:3305:x1875987821260544:12345-0@lo:103: 00010000:00010000:0.0:1789081550.723065:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789081550.723071:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e10c29e1000/0xb7cb3d7479d5f67f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f678 expref: 21 pid: 5784 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.723080:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e10c29e1000/0xb7cb3d7479d5f67f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f678 expref: 21 pid: 5784 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.723097:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10c29e1000/0xb7cb3d7479d5f67f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb7cb3d7479d5f678 expref: 21 pid: 5784 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.723111:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789081550.723503:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821260416:0@lo:103: 00000100:00100000:3.0:1789081550.723552:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081550.723566:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821260928:0@lo:103: 00000100:00100000:0.0:1789081550.723654:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+20:3305:x1875987821260544:12345-0@lo:103: Request processed in 95us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081550.723663:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789081550.723680:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821260416 00000100:00100000:0.0:1789081550.723684:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821260416 00010000:00010000:0.0:1789081550.723696:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e10e13afc00/0xb7cb3d7479d5f68d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f686 expref: 20 pid: 5782 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081550.723709:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789081550.723715:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+20:3305:x1875987821260160:12345-0@lo:103: 00010000:00010000:0.0:1789081550.723725:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789081550.723729:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e10e13aea00/0xb7cb3d7479d5f6d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f6cc expref: 20 pid: 5783 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.723738:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e10e13aea00/0xb7cb3d7479d5f6d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f6cc expref: 20 pid: 5783 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.723756:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10e13aea00/0xb7cb3d7479d5f6d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb7cb3d7479d5f6cc expref: 20 pid: 5783 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.723766:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789081550.723789:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3305:x1875987821260160:12345-0@lo:103: Request processed in 74us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081550.723795:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789081550.723808:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789081550.723814:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:3305:x1875987821260672:12345-0@lo:103: 00010000:00010000:0.0:1789081550.723820:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789081550.723825:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e10e13ae600/0xb7cb3d7479d5f671 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f66a expref: 18 pid: 5782 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.723833:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e10e13ae600/0xb7cb3d7479d5f671 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f66a expref: 18 pid: 5782 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.723842:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10e13ae600/0xb7cb3d7479d5f671 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb7cb3d7479d5f66a expref: 18 pid: 5782 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.723850:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789081550.723869:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:3305:x1875987821260672:12345-0@lo:103: Request processed in 55us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081550.723875:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789081550.723886:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789081550.723892:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:3304:x1875987821260416:12345-0@lo:103: 00010000:00010000:0.0:1789081550.723901:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789081550.723906:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e10e13afc00/0xb7cb3d7479d5f68d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f686 expref: 16 pid: 5782 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.723932:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e10e13afc00/0xb7cb3d7479d5f68d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f686 expref: 16 pid: 5782 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.723943:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10e13afc00/0xb7cb3d7479d5f68d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb7cb3d7479d5f686 expref: 16 pid: 5782 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081550.723951:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789081550.723974:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+15:3304:x1875987821260416:12345-0@lo:103: Request processed in 82us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081550.723981:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789081550.724015:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821260160:0@lo:103: 00000100:00100000:0.0:1789081550.724022:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821260672:0@lo:103: 00000100:00100000:0.0:1789081550.724029:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821260544:0@lo:103: 00000100:00100000:3.0:1789081550.724138:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081550.724239:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821260416:0@lo:103: 00000100:00100000:3.0:1789081550.724254:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789081550.724262:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821260288:0@lo:103: 00000100:00100000:3.0:1789081550.724297:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081550.724312:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821260800:0@lo:103: 00000100:00100000:3.0:1789081550.724330:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081550.724364:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821260928 00000100:00100000:3.0:1789081550.724368:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821260928 00010000:00010000:3.0:1789081550.724383:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e10c0030000/0xb7cb3d7479d5f61d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f616 expref: 15 pid: 5782 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081550.724397:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821260288 00000100:00100000:3.0:1789081550.724399:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821260288 00010000:00010000:3.0:1789081550.724407:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e10e13af400/0xb7cb3d7479d5f6a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f6a2 expref: 16 pid: 5782 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081550.724416:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821260800 00000100:00100000:3.0:1789081550.724418:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821260800 00010000:00010000:3.0:1789081550.724427:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e10c0031600/0xb7cb3d7479d5f647 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f640 expref: 17 pid: 5783 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081550.724440:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789081550.724446:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:3304:x1875987821260928:12345-0@lo:103: 00010000:00010000:3.0:1789081550.724453:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081550.724457:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e10c0030000/0xb7cb3d7479d5f61d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f616 expref: 17 pid: 5782 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081550.724464:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e10c0030000/0xb7cb3d7479d5f61d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f616 expref: 17 pid: 5782 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081550.724476:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10c0030000/0xb7cb3d7479d5f61d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb7cb3d7479d5f616 expref: 17 pid: 5782 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081550.724490:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789081550.724519:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:3304:x1875987821260928:12345-0@lo:103: Request processed in 73us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081550.724551:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789081550.724565:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789081550.724718:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee551687-7675-4fc6-9be1-2ccb62bdd809+15:3304:x1875987821260288:12345-0@lo:103: 00010000:00010000:3.0:1789081550.724726:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081550.724731:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e10e13af400/0xb7cb3d7479d5f6a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f6a2 expref: 15 pid: 5782 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081550.724739:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e10e13af400/0xb7cb3d7479d5f6a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f6a2 expref: 15 pid: 5782 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081550.724750:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10e13af400/0xb7cb3d7479d5f6a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb7cb3d7479d5f6a2 expref: 15 pid: 5782 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081550.724758:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789081550.724778:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:3304:x1875987821260288:12345-0@lo:103: Request processed in 207us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081550.724784:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789081550.724796:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789081550.724801:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c9389050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:3304:x1875987821260800:12345-0@lo:103: 00010000:00010000:3.0:1789081550.724809:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081550.724813:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e10c0031600/0xb7cb3d7479d5f647 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f640 expref: 13 pid: 5783 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081550.724821:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e10c0031600/0xb7cb3d7479d5f647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f640 expref: 13 pid: 5783 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081550.724836:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10c0031600/0xb7cb3d7479d5f647 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb7cb3d7479d5f640 expref: 13 pid: 5783 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081550.724846:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789081550.724865:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c9389050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:3304:x1875987821260800:12345-0@lo:103: Request processed in 64us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081550.724871:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789081550.725095:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821260288:0@lo:103: 00000100:00100000:3.0:1789081550.725107:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821260800:0@lo:103: 00000100:00100000:3.0:1789081550.725114:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821260928:0@lo:103: 00000100:00100000:0.0:1789081550.742505:0:8301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c7a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8301:1875987821259008:192.168.201.17@tcp:104: 00000100:00100000:0.0:1789081550.742553:0:8301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c79c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8301:1875987821259136:192.168.201.17@tcp:104: 00010000:00010000:0.0:1789081550.742733:0:8301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e1101999c00/0xb7cb3d7479d5f720 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081550.746897:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081550.746947:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081550.747244:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796070400 00000100:00100000:1.0:1789081550.747255:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796070400 00010000:00010000:1.0:1789081550.747307:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e10e13af800/0xb7cb3d7479d5f6e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a72a expref: 10 pid: 5783 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081550.747345:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796070528 00000100:00100000:1.0:1789081550.747348:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796070528 00010000:00010000:1.0:1789081550.747361:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e1101999e00/0xb7cb3d7479d5f6e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a723 expref: 11 pid: 5784 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081550.747445:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 19 00000100:00100000:1.0:1789081550.747456:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1100641880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+11:2350:x1875987796070400:12345-192.168.201.17@tcp:103: 00010000:00010000:1.0:1789081550.747470:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789081550.747476:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e10e13af800/0xb7cb3d7479d5f6e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a72a expref: 11 pid: 5783 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081550.747489:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e10e13af800/0xb7cb3d7479d5f6e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a72a expref: 11 pid: 5783 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081550.747506:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10e13af800/0xb7cb3d7479d5f6e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a72a expref: 11 pid: 5783 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081550.747585:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789081550.747642:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1100641880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:2350:x1875987796070400:12345-192.168.201.17@tcp:103: Request processed in 187us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081550.747649:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 19 00000100:00100000:1.0:1789081550.747668:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 20 00000100:00100000:1.0:1789081550.747675:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1100643480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+9:2350:x1875987796070528:12345-192.168.201.17@tcp:103: 00010000:00010000:1.0:1789081550.747681:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789081550.747686:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e1101999e00/0xb7cb3d7479d5f6e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a723 expref: 9 pid: 5784 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081550.747695:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e1101999e00/0xb7cb3d7479d5f6e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a723 expref: 9 pid: 5784 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081550.747705:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e1101999e00/0xb7cb3d7479d5f6e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a723 expref: 9 pid: 5784 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081550.747715:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e1101999c00/0xb7cb3d7479d5f720 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081550.747723:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e1101999c00/0xb7cb3d7479d5f720 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081550.747740:0:5774:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e1101999c00/0xb7cb3d7479d5f720 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081550.747748:0:5774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e1101999c00/0xb7cb3d7479d5f720 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081550.747755:0:5774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e1101999c00/0xb7cb3d7479d5f720 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081550.747768:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e1101999c00/0xb7cb3d7479d5f720 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081550.747774:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999c00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:1.0:1789081550.747778:0:5774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e1101999c00/0xb7cb3d7479d5f720 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081550.747786:0:5774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e1101999c00/0xb7cb3d7479d5f720 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081550.747800:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e1101999c00/0xb7cb3d7479d5f720 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081550.747810:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789081550.747830:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1100643480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+8:2350:x1875987796070528:12345-192.168.201.17@tcp:103: Request processed in 156us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081550.747836:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 20 00010000:00010000:1.0:1789081550.752430:0:8301:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e1101999c00/0xb7cb3d7479d5f720 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081550.752454:0:8301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e1101999c00/0xb7cb3d7479d5f720 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081550.752462:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e1101999c00/0xb7cb3d7479d5f720 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081550.816437:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081550.816473:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081550.816493:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081550.816520:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796070784 00000100:00100000:2.0:1789081550.816542:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796070784 00000100:00100000:2.0:1789081550.816591:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796070912 00000100:00100000:2.0:1789081550.816593:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796070912 00000100:00100000:2.0:1789081550.816612:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 11 00000100:00100000:2.0:1789081550.816621:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1100643800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+5:2351:x1875987796070784:12345-192.168.201.17@tcp:400: 00000100:00100000:2.0:1789081550.816687:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1100643800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+5:2351:x1875987796070784:12345-192.168.201.17@tcp:400: Request processed in 67us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081550.816694:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 11 00000100:00100000:2.0:1789081550.816710:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 12 00000100:00100000:2.0:1789081550.816715:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1100640700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+5:2351:x1875987796070912:12345-192.168.201.17@tcp:400: 00000100:00100000:2.0:1789081550.816735:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1100640700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+5:2351:x1875987796070912:12345-192.168.201.17@tcp:400: Request processed in 20us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081550.816741:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 12 00000100:00100000:2.0:1789081550.816755:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796070656 00000100:00100000:2.0:1789081550.816758:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796070656 00000100:00100000:2.0:1789081550.816805:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 29 00000100:00100000:2.0:1789081550.816811:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1100640a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+6:2351:x1875987796070656:12345-192.168.201.17@tcp:400: 00000100:00100000:2.0:1789081550.816833:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1100640a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+6:2351:x1875987796070656:12345-192.168.201.17@tcp:400: Request processed in 22us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081550.816838:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 29 00000100:00080000:2.0:1789081550.816853:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789081550.816858:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789081550.816859:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789081551.651670:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789081552.476700:0:5786:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789081552.476710:0:5786:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e10ff7e6800 from 39 10000000:01000000:1.0:1789081552.476716:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789081552.476772:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae800/0xb7cb3d7479d5f727 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081552.476801:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae800/0xb7cb3d7479d5f727 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081552.476814:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae800/0xb7cb3d7479d5f727 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081552.476857:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821261056:0@lo:101: 00000100:00100000:1.0:1789081552.476933:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081552.477010:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d17d3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789081552.477369:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821261056 00000100:00100000:2.0:1789081552.477385:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821261056 00000100:00100000:2.0:1789081552.477454:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789081552.477465:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+12:5786:x1875987821261056:12345-0@lo:101: 00010000:00010000:2.0:1789081552.477479:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081552.477498:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10c29e1a00/0xb7cb3d7479d5f72e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f727 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081552.477753:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10c29e1a00/0xb7cb3d7479d5f72e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f727 expref: 13 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081552.477765:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10c29e1a00/0xb7cb3d7479d5f72e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f727 expref: 13 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081552.477778:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10c29e1a00, rc 0) 00000100:00100000:2.0:1789081552.477933:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:5786:x1875987821261056:12345-0@lo:101: Request processed in 469us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081552.477940:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789081552.483314:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821261056:0@lo:101: 00010000:00010000:1.0:1789081552.483357:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae800/0xb7cb3d7479d5f727 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f72e expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081552.483371:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae800/0xb7cb3d7479d5f727 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f72e expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081552.483452:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821261184:0@lo:501: 00000100:00100000:1.0:1789081552.484001:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081552.484073:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d17d3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789081552.484100:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821261184 00000100:00100000:2.0:1789081552.484109:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821261184 00000100:00100000:2.0:1789081552.484164:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789081552.484174:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:5786:x1875987821261184:12345-0@lo:501: 00000100:00100000:2.0:1789081552.484502:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:5786:x1875987821261184:12345-0@lo:501: Request processed in 328us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081552.484510:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789081552.484744:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821261184:0@lo:501: 00000100:00100000:1.0:1789081552.484782:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821261312:0@lo:503: 00000100:00100000:1.0:1789081552.485030:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081552.485114:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821261312 00000100:00100000:2.0:1789081552.485120:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821261312 00000100:00100000:1.0:1789081552.485132:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d17d3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789081552.485158:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789081552.485166:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:5786:x1875987821261312:12345-0@lo:503: 00000100:00100000:2.0:1789081552.485348:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:5786:x1875987821261312:12345-0@lo:503: Request processed in 182us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081552.485362:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789081552.485467:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821261312:0@lo:503: 00000100:00100000:2.0:1789081552.486074:0:8318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1100641f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:8318:1875987821261440:0@lo:502: 00000100:00100000:2.0:1789081552.486120:0:8318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081552.486156:0:8318:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10ff6b1300 going to sleep for 11 seconds 00000100:00100000:3.0:1789081552.486236:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821261440 00000100:00100000:3.0:1789081552.486253:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821261440 00000100:00100000:3.0:1789081552.486349:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789081552.486358:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:8318:x1875987821261440:12345-0@lo:502: 00000100:00100000:3.0:1789081552.486605:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:8318:x1875987821261440:12345-0@lo:502: Request processed in 248us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081552.486614:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789081552.486644:0:8318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1100641f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:8318:1875987821261440:0@lo:502: 00000100:00100000:2.0:1789081552.486690:0:8318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1100641f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:8318:1875987821261568:0@lo:502: 00000100:00100000:2.0:1789081552.486725:0:8318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081552.489611:0:8318:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10ff6b1300 going to sleep for 11 seconds 00000100:00100000:0.0:1789081552.497748:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821261568 00000100:00100000:0.0:1789081552.497766:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821261568 00000100:00100000:0.0:1789081552.497849:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789081552.497861:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:8318:x1875987821261568:12345-0@lo:502: 00000100:00100000:0.0:1789081552.498957:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:8318:x1875987821261568:12345-0@lo:502: Request processed in 1092us (12225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081552.498978:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789081552.500594:0:8318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1100641f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:8318:1875987821261568:0@lo:502: 00000040:00080000:2.0:1789081552.500664:0:8318:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789081552.503463:0:5786:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789081552.503494:0:5786:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789081552.503508:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae800/0xb7cb3d7479d5f727 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f72e expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081552.503520:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae800/0xb7cb3d7479d5f727 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f72e expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789081552.503570:0:5786:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1789081552.503573:0:5786:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1789081552.503576:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789081552.503619:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c1486000/0xb7cb3d7479d5f735 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081552.503627:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e10c1486000/0xb7cb3d7479d5f735 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081552.503647:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e10c1486000/0xb7cb3d7479d5f735 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081552.503671:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821261696:0@lo:101: 00000100:00100000:0.0:1789081552.503739:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081552.503788:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c88109c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789081552.504031:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821261696 00000100:00100000:2.0:1789081552.504048:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821261696 00000100:00100000:2.0:1789081552.504102:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789081552.504111:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+13:5786:x1875987821261696:12345-0@lo:101: 00010000:00010000:2.0:1789081552.504130:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081552.504444:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10c29e0e00/0xb7cb3d7479d5f73c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f735 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081552.504473:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10c29e0e00/0xb7cb3d7479d5f73c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f735 expref: 14 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081552.504484:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10c29e0e00/0xb7cb3d7479d5f73c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f735 expref: 14 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081552.504494:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10c29e0e00, rc 0) 00000100:00100000:2.0:1789081552.504564:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:5786:x1875987821261696:12345-0@lo:101: Request processed in 453us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081552.504586:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789081552.504683:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821261696:0@lo:101: 00010000:00010000:1.0:1789081552.504706:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e10c1486000/0xb7cb3d7479d5f735 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f73c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081552.504715:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e10c1486000/0xb7cb3d7479d5f735 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f73c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081552.504769:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821261824:0@lo:501: 00000100:00100000:1.0:1789081552.504802:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081552.505219:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10e09bad80 going to sleep for 11 seconds 00000100:00100000:0.0:1789081552.505299:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821261824 00000100:00100000:0.0:1789081552.505306:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821261824 00000100:00100000:0.0:1789081552.505334:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789081552.505350:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:5786:x1875987821261824:12345-0@lo:501: 00000100:00100000:0.0:1789081552.505663:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:5786:x1875987821261824:12345-0@lo:501: Request processed in 322us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081552.505677:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789081552.505877:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821261824:0@lo:501: 00000100:00100000:1.0:1789081552.505914:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821261952:0@lo:503: 00000100:00100000:1.0:1789081552.505958:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081552.505985:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10e09bad80 going to sleep for 11 seconds 00000100:00100000:0.0:1789081552.506537:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821261952 00000100:00100000:0.0:1789081552.506546:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821261952 00000100:00100000:0.0:1789081552.506572:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789081552.506579:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:5786:x1875987821261952:12345-0@lo:503: 00000100:00100000:0.0:1789081552.506777:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:5786:x1875987821261952:12345-0@lo:503: Request processed in 198us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081552.506784:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789081552.507503:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821261952:0@lo:503: 00000100:00100000:1.0:1789081552.508423:0:8319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:8319:1875987821262080:0@lo:502: 00000100:00100000:1.0:1789081552.508488:0:8319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081552.508575:0:8319:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10e09bad80 going to sleep for 11 seconds 00000100:00100000:0.0:1789081552.508809:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821262080 00000100:00100000:0.0:1789081552.508816:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821262080 00000100:00100000:0.0:1789081552.508878:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789081552.508888:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:8319:x1875987821262080:12345-0@lo:502: 00000100:00100000:0.0:1789081552.509465:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:8319:x1875987821262080:12345-0@lo:502: Request processed in 577us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081552.509473:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789081552.509839:0:8319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:8319:1875987821262080:0@lo:502: 00000020:01000000:1.0:1789081552.509872:0:8319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789081552.509882:0:8319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789081552.509885:0:8319:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789081552.509891:0:8319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789081552.509921:0:8319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:8319:1875987821262208:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789081552.509970:0:8319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081552.510071:0:8319:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d1b9fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789081552.518518:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821262208 00000100:00100000:3.0:1789081552.518560:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821262208 00000100:00100000:2.0:1789081552.518742:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789081552.518755:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:8319:x1875987821262208:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789081552.519413:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:8319:x1875987821262208:12345-0@lo:502:llog_process_th.0 Request processed in 657us (9439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081552.519421:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789081552.519764:0:8319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:8319:1875987821262208:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789081552.519818:0:8319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789081552.519825:0:8319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789081552.519841:0:8319:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789081552.519848:0:8319:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1789081552.520793:0:5786:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1789081552.520814:0:5786:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789081552.520826:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c1486000/0xb7cb3d7479d5f735 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f73c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081552.520850:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e10c1486000/0xb7cb3d7479d5f735 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f73c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789081552.520861:0:5786:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789081552.520863:0:5786:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e10fad3e000 from 39 10000000:01000000:0.0:1789081552.520867:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789081552.520905:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c1486c00/0xb7cb3d7479d5f743 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081552.520927:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e10c1486c00/0xb7cb3d7479d5f743 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081552.520938:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e10c1486c00/0xb7cb3d7479d5f743 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081552.520961:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b32a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821262336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789081552.521435:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081552.521490:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c88100c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789081552.521600:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821262336 00000100:00100000:1.0:1789081552.521607:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821262336 00000100:00100000:1.0:1789081552.521661:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789081552.521669:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:5786:x1875987821262336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789081552.521682:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081552.521694:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10e13af000/0xb7cb3d7479d5f74a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f743 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081552.521716:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10e13af000/0xb7cb3d7479d5f74a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f743 expref: 15 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081552.521726:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10e13af000/0xb7cb3d7479d5f74a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f743 expref: 15 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081552.521734:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13af000, rc 0) 00000100:00100000:1.0:1789081552.521779:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+15:5786:x1875987821262336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081552.521785:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789081552.521987:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b32a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821262336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789081552.522002:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e10c1486c00/0xb7cb3d7479d5f743 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f74a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081552.522021:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e10c1486c00/0xb7cb3d7479d5f743 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f74a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081552.522098:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c7b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821262464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789081552.522124:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081552.522160:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c8e839c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789081552.522316:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821262464 00000100:00100000:0.0:1789081552.522321:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821262464 00000100:00100000:0.0:1789081552.522357:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789081552.522363:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+15:5786:x1875987821262464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789081552.522619:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+15:5786:x1875987821262464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 255us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081552.522626:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789081552.523136:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c7b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821262464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789081552.523182:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c7b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821262592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789081552.523220:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081552.523258:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c8e839c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789081552.523403:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821262592 00000100:00100000:0.0:1789081552.523407:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821262592 00000100:00100000:0.0:1789081552.523442:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789081552.523448:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+15:5786:x1875987821262592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789081552.523623:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+15:5786:x1875987821262592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 174us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081552.523631:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789081552.523760:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c7b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821262592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789081552.524217:0:8320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c7b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:8320:1875987821262720:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789081552.524267:0:8320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081552.524296:0:8320:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c8e83480 going to sleep for 11 seconds 00000100:00100000:1.0:1789081552.524434:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821262720 00000100:00100000:1.0:1789081552.524440:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821262720 00000100:00100000:1.0:1789081552.524474:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789081552.524481:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:8320:x1875987821262720:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789081552.524693:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:8320:x1875987821262720:12345-0@lo:502:llog_process_th.0 Request processed in 211us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081552.524708:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789081552.525033:0:8320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c7b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:8320:1875987821262720:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789081552.525138:0:8320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c7b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:8320:1875987821262848:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789081552.525180:0:8320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081552.525207:0:8320:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c8e83480 going to sleep for 11 seconds 00000100:00100000:1.0:1789081552.525318:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821262848 00000100:00100000:1.0:1789081552.525323:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821262848 00000100:00100000:1.0:1789081552.525426:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789081552.525434:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+15:8320:x1875987821262848:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789081552.525760:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+15:8320:x1875987821262848:12345-0@lo:502:llog_process_th.0 Request processed in 327us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081552.525769:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789081552.525911:0:8320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c7b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:8320:1875987821262848:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789081552.525936:0:8320:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789081552.526461:0:5786:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1789081552.526491:0:5786:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789081552.526502:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c1486c00/0xb7cb3d7479d5f743 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f74a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081552.526514:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e10c1486c00/0xb7cb3d7479d5f743 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f74a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789081552.526562:0:5786:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789081552.526566:0:5786:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1789081552.526569:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789081552.526605:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10e13af800/0xb7cb3d7479d5f751 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081552.526614:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e10e13af800/0xb7cb3d7479d5f751 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081552.526623:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e10e13af800/0xb7cb3d7479d5f751 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081552.526776:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821262976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789081552.526908:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081552.526941:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e1101986000 going to sleep for 11 seconds 00000100:00100000:3.0:1789081552.526998:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821262976 00000100:00100000:3.0:1789081552.527004:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821262976 00000100:00100000:3.0:1789081552.527231:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789081552.527253:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+15:5786:x1875987821262976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789081552.527266:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081552.527288:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e1101999200/0xb7cb3d7479d5f758 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f751 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081552.527314:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e1101999200/0xb7cb3d7479d5f758 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f751 expref: 16 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081552.527324:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e1101999200/0xb7cb3d7479d5f758 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f751 expref: 16 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081552.527334:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101999200, rc 0) 00000100:00100000:3.0:1789081552.527769:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:5786:x1875987821262976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 528us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081552.527778:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789081552.529263:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821262976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789081552.529290:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e10e13af800/0xb7cb3d7479d5f751 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f758 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081552.529303:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e10e13af800/0xb7cb3d7479d5f751 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f758 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081552.529521:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821263104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789081552.529799:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081552.529900:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e1101986000 going to sleep for 11 seconds 00000100:00100000:0.0:1789081552.529974:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821263104 00000100:00100000:0.0:1789081552.529981:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821263104 00000100:00100000:0.0:1789081552.530233:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789081552.530269:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:5786:x1875987821263104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789081552.530825:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:5786:x1875987821263104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 557us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081552.530843:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789081552.533456:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821263104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789081552.534298:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c7b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821263232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789081552.544385:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081552.544441:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c8e839c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789081552.544562:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821263232 00000100:00100000:3.0:1789081552.544572:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821263232 00000100:00100000:3.0:1789081552.544631:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789081552.544652:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:5786:x1875987821263232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789081552.544890:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:5786:x1875987821263232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 239us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081552.544898:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789081552.545380:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c7b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821263232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789081552.546054:0:8321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1100641f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:8321:1875987821263360:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789081552.546127:0:8321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081552.546304:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821263360 00000100:00100000:1.0:1789081552.546312:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821263360 00000100:00100000:1.0:1789081552.546365:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789081552.546374:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:8321:x1875987821263360:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789081552.546650:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:8321:x1875987821263360:12345-0@lo:502:llog_process_th.0 Request processed in 276us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081552.546660:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789081552.546895:0:8321:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10ff6b13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789081552.546918:0:8321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1100641f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:8321:1875987821263360:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789081552.546948:0:8321:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789081552.546960:0:8321:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789081552.546963:0:8321:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789081552.546970:0:8321:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789081552.546996:0:8321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1100641f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:8321:1875987821263488:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789081552.547032:0:8321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081552.547069:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821263488 00000100:00100000:2.0:1789081552.547074:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821263488 00000100:00100000:2.0:1789081552.547098:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789081552.547105:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:8321:x1875987821263488:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789081552.547517:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:8321:x1875987821263488:12345-0@lo:502:llog_process_th.0 Request processed in 411us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081552.547553:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789081552.547591:0:8321:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10ff6b13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789081552.547605:0:8321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1100641f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:8321:1875987821263488:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789081552.547624:0:8321:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789081552.547629:0:8321:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789081552.547630:0:8321:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789081552.547634:0:8321:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1789081552.550302:0:5786:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1789081552.550342:0:5786:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789081552.550356:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10e13af800/0xb7cb3d7479d5f751 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f758 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081552.550370:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e10e13af800/0xb7cb3d7479d5f751 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f758 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789081552.550405:0:5786:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789081552.550408:0:5786:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e10ee974800 from 39 10000000:01000000:3.0:1789081552.550411:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789081552.550458:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101998c00/0xb7cb3d7479d5f75f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081552.550467:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e1101998c00/0xb7cb3d7479d5f75f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081552.550478:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e1101998c00/0xb7cb3d7479d5f75f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081552.550506:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c78a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821263616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789081552.550604:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081552.550665:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c8e83000 going to sleep for 11 seconds 00000100:00100000:2.0:1789081552.552206:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821263616 00000100:00100000:2.0:1789081552.552221:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821263616 00000100:00100000:2.0:1789081552.552306:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789081552.552318:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:5786:x1875987821263616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789081552.552335:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081552.552365:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10c29e1000/0xb7cb3d7479d5f766 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f75f expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081552.552398:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10c29e1000/0xb7cb3d7479d5f766 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f75f expref: 17 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081552.552410:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10c29e1000/0xb7cb3d7479d5f766 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f75f expref: 17 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081552.552419:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10c29e1000, rc 0) 00000100:00100000:2.0:1789081552.552494:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:5786:x1875987821263616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (1890us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081552.552501:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789081552.552593:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c78a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821263616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789081552.552612:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e1101998c00/0xb7cb3d7479d5f75f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f766 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081552.552622:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e1101998c00/0xb7cb3d7479d5f75f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f766 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081552.552721:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1100641f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821263744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789081552.552759:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081552.552792:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10ff6b1900 going to sleep for 11 seconds 00000100:00100000:3.0:1789081552.553359:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821263744 00000100:00100000:3.0:1789081552.553366:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821263744 00000100:00100000:3.0:1789081552.553408:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789081552.553415:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:5786:x1875987821263744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789081552.553762:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:5786:x1875987821263744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 347us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081552.553771:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789081552.555492:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1100641f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821263744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789081552.555572:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1100641f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821263872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789081552.555663:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081552.555701:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10ff6b1900 going to sleep for 11 seconds 00000100:00100000:3.0:1789081552.556081:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821263872 00000100:00100000:3.0:1789081552.556089:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821263872 00000100:00100000:3.0:1789081552.556134:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789081552.556152:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:5786:x1875987821263872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789081552.556390:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:5786:x1875987821263872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 248us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081552.556405:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789081552.556814:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1100641f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821263872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789081552.557510:0:8322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1100641f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:8322:1875987821264000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789081552.557595:0:8322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081552.557630:0:8322:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10ff6b10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789081552.558827:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821264000 00000100:00100000:3.0:1789081552.558852:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821264000 00000100:00100000:3.0:1789081552.558909:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789081552.558918:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:8322:x1875987821264000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789081552.559604:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:8322:x1875987821264000:12345-0@lo:502:llog_process_th.0 Request processed in 684us (2006us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081552.559612:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789081552.561728:0:8322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1100641f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:8322:1875987821264000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789081552.561820:0:8322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1100641f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:8322:1875987821264128:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789081552.562437:0:8322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081552.562586:0:8322:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10ff6b10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789081552.568699:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821264128 00000100:00100000:0.0:1789081552.568720:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821264128 00000100:00100000:0.0:1789081552.568803:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789081552.568813:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:8322:x1875987821264128:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789081552.570153:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:8322:x1875987821264128:12345-0@lo:502:llog_process_th.0 Request processed in 1326us (7702us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081552.570165:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789081552.571310:0:8322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1100641f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:8322:1875987821264128:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789081552.571462:0:8322:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789081552.571791:0:5786:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789081552.571813:0:5786:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789081552.571825:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101998c00/0xb7cb3d7479d5f75f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f766 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081552.572250:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e1101998c00/0xb7cb3d7479d5f75f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f766 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789081552.572283:0:5786:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789081552.572286:0:5786:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1789081552.572289:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789081552.572331:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1200/0xb7cb3d7479d5f76d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081552.572409:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1200/0xb7cb3d7479d5f76d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081552.572422:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1200/0xb7cb3d7479d5f76d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081552.572447:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1100642680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821264256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789081552.572512:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081552.572673:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10ff6b1240 going to sleep for 11 seconds 00000100:00100000:3.0:1789081552.572820:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821264256 00000100:00100000:3.0:1789081552.572938:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821264256 00000100:00100000:3.0:1789081552.573171:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789081552.573182:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:5786:x1875987821264256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789081552.573196:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081552.573210:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e1101999a00/0xb7cb3d7479d5f774 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f76d expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081552.573234:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e1101999a00/0xb7cb3d7479d5f774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f76d expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081552.573258:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e1101999a00/0xb7cb3d7479d5f774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f76d expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081552.573267:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101999a00, rc 0) 00000100:00100000:3.0:1789081552.573322:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:5786:x1875987821264256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081552.573495:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1100642680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821264256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789081552.573510:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1200/0xb7cb3d7479d5f76d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f774 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081552.573519:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1200/0xb7cb3d7479d5f76d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f774 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081552.573601:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1100642680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821264384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789081552.573633:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081552.573675:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789081552.573850:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10ff6b1240 going to sleep for 11 seconds 00000100:00100000:3.0:1789081552.574033:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821264384 00000100:00100000:3.0:1789081552.574045:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821264384 00000100:00100000:3.0:1789081552.574066:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789081552.574073:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:5786:x1875987821264384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789081552.574385:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:5786:x1875987821264384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 311us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081552.574393:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789081552.574789:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1100642680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821264384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789081552.574851:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1100642680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821264512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789081552.574912:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081552.574945:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10ff6b1240 going to sleep for 11 seconds 00000100:00100000:3.0:1789081552.575159:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821264512 00000100:00100000:3.0:1789081552.575164:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821264512 00000100:00100000:3.0:1789081552.575188:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789081552.575195:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:5786:x1875987821264512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789081552.575399:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:5786:x1875987821264512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 203us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081552.575407:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789081552.575612:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1100642680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821264512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789081552.576318:0:8323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1100642680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:8323:1875987821264640:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789081552.576377:0:8323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081552.576411:0:8323:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10ff6b1180 going to sleep for 11 seconds 00000100:00100000:3.0:1789081552.576508:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821264640 00000100:00100000:3.0:1789081552.576514:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821264640 00000100:00100000:3.0:1789081552.576571:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789081552.576578:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:8323:x1875987821264640:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789081552.576897:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:8323:x1875987821264640:12345-0@lo:502:llog_process_th.0 Request processed in 319us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081552.576906:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789081552.577021:0:8323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1100642680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:8323:1875987821264640:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789081552.577228:0:8323:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789081552.577248:0:8323:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789081552.577250:0:8323:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789081552.577257:0:8323:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789081552.577279:0:8323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1100642680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:8323:1875987821264768:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789081552.577318:0:8323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081552.577416:0:8323:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10ff6b1180 going to sleep for 11 seconds 00000100:00100000:1.0:1789081552.577511:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821264768 00000100:00100000:1.0:1789081552.577517:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821264768 00000100:00100000:1.0:1789081552.577568:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789081552.577576:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:8323:x1875987821264768:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789081552.577810:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:8323:x1875987821264768:12345-0@lo:502:llog_process_th.0 Request processed in 234us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081552.577914:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789081552.578276:0:8323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1100642680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:8323:1875987821264768:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789081552.578305:0:8323:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789081552.578311:0:8323:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789081552.578314:0:8323:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789081552.578317:0:8323:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1789081552.578596:0:5786:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1789081552.578613:0:5786:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789081552.578623:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1200/0xb7cb3d7479d5f76d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f774 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081552.578705:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1200/0xb7cb3d7479d5f76d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f774 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789081552.578716:0:5786:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789081552.578719:0:5786:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9e10d1a03380 from 1 10000000:01000000:3.0:1789081552.578722:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789081552.578752:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101998400/0xb7cb3d7479d5f77b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081552.578760:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e1101998400/0xb7cb3d7479d5f77b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081552.578771:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e1101998400/0xb7cb3d7479d5f77b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081552.578790:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c79880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821264896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789081552.578928:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081552.578966:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c8e83d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789081552.579034:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821264896 00000100:00100000:1.0:1789081552.581206:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821264896 00000100:00100000:1.0:1789081552.581301:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789081552.581312:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:5786:x1875987821264896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789081552.581330:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081552.581622:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10e13afc00/0xb7cb3d7479d5f782 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f77b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081552.581899:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10e13afc00/0xb7cb3d7479d5f782 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f77b expref: 19 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081552.581912:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10e13afc00/0xb7cb3d7479d5f782 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f77b expref: 19 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081552.581922:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13afc00, rc 0) 00000100:00100000:1.0:1789081552.581997:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:5786:x1875987821264896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 687us (3069us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081552.582004:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789081552.582252:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c79880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821264896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789081552.582271:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e1101998400/0xb7cb3d7479d5f77b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f782 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081552.582281:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e1101998400/0xb7cb3d7479d5f77b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f782 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081552.582367:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c79880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821265024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789081552.582402:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081552.582465:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c8e83d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789081552.582600:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821265024 00000100:00100000:2.0:1789081552.582606:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821265024 00000100:00100000:2.0:1789081552.582702:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789081552.582710:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:5786:x1875987821265024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789081552.582986:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:5786:x1875987821265024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 277us (582us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789081552.582994:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789081552.583283:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c79880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821265024:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1789081552.583318:0:5786:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789081552.583327:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101998400/0xb7cb3d7479d5f77b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f782 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081552.583335:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e1101998400/0xb7cb3d7479d5f77b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f782 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081552.670694:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789081552.733663:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821265152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789081552.733744:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081552.734385:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821265152 00000100:00100000:2.0:1789081552.734396:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821265152 00000100:00100000:2.0:1789081552.734483:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789081552.734494:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821265152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789081552.734562:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789081552.734692:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789081552.743540:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821265152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9020us (9767us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081552.743559:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1789081552.753342:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e11006a7800 x1875987821265152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081568 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081552.753372:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821265152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789081553.245838:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789081553.245872:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821265280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789081553.245951:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081553.246207:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821265280 00000100:00100000:2.0:1789081553.246216:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821265280 00000100:00100000:2.0:1789081553.246294:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789081553.246303:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1100642680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821265280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789081553.246343:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789081553.246449:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1100642680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821265280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 147us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081553.246456:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1789081553.246494:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10d1b33800 x1875987821265280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081569 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789081553.246512:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821265280:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789081553.246598:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789081553.254493:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821265792:0@lo:400:kworker.0 00000100:00100000:3.0:1789081553.254586:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081553.254642:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789081553.254649:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875987821265664:0@lo:400:kworker.0 00000100:00100000:3.0:1789081553.254677:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081553.254711:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821265792 00000100:00100000:3.0:1789081553.254719:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821265792 00000100:00100000:3.0:1789081553.254767:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789081553.254777:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821265792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081553.254949:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821265792:12345-0@lo:400:kworker.0 Request processed in 69us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081553.254958:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789081553.254984:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821265664 00000100:00100000:3.0:1789081553.254987:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821265664 00000100:00100000:3.0:1789081553.255020:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789081553.255094:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875987821265664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081553.255126:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875987821265664:12345-0@lo:400:kworker.0 Request processed in 100us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081553.255147:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1789081553.255166:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789081553.255197:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875987821265664:0@lo:400:kworker.0 00010000:00080000:3.0:1789081553.255211:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10f5c79c00 x1875987821265792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789081569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789081553.255221:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821265792:0@lo:400:kworker.0 00000100:00100000:0.0:1789081553.255387:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875987821265536:0@lo:400:kworker.0 00000100:00100000:0.0:1789081553.255418:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081553.255449:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789081553.255454:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821265408:0@lo:400:kworker.0 00000100:00100000:0.0:1789081553.255481:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081553.255516:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875987821265920:0@lo:400:kworker.0 00000100:00100000:0.0:1789081553.255566:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081553.255690:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821265408 00000100:00100000:1.0:1789081553.255696:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821265408 00000100:00100000:1.0:1789081553.255732:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789081553.255740:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3304:x1875987821265408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081553.255775:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3304:x1875987821265408:12345-0@lo:400:kworker.0 Request processed in 36us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081553.255782:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789081553.255876:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821265408:0@lo:400:kworker.0 00000100:00100000:3.0:1789081553.255940:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821265536 00000100:00100000:3.0:1789081553.255944:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821265536 00000100:00100000:3.0:1789081553.255972:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821265920 00000100:00100000:3.0:1789081553.255974:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821265920 00000100:00100000:3.0:1789081553.255993:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789081553.255998:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875987821265536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081553.256181:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789081553.256195:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875987821265920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081553.256249:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875987821265536:12345-0@lo:400:kworker.0 Request processed in 250us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081553.256255:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1789081553.256269:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789081553.263014:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875987821265920:12345-0@lo:400:kworker.0 Request processed in 6804us (7432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081553.263041:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789081553.263745:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875987821265920:0@lo:400:kworker.0 00000100:00100000:3.0:1789081553.263764:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875987821265536:0@lo:400:kworker.0 00010000:00010000:0.0:1789081553.694810:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081554.717012:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081555.747171:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789081555.931665:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081555.931718:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081555.931750:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081555.931786:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081555.931818:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081555.931870:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796071040 00000100:00100000:2.0:1789081555.931882:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796071040 00000100:00100000:2.0:1789081555.931937:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796071168 00000100:00100000:2.0:1789081555.931941:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796071168 00000100:00100000:2.0:1789081555.931959:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 165 00000100:00100000:2.0:1789081555.931969:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+9:5569:x1875987796071040:12345-192.168.201.17@tcp:101: 00010000:00010000:2.0:1789081555.932000:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081555.932020:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10c29e1e00/0xb7cb3d7479d5f789 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a78c expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081555.932049:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10c29e1e00/0xb7cb3d7479d5f789 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a78c expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081555.932061:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10c29e1e00/0xb7cb3d7479d5f789 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a78c expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081555.932072:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10c29e1e00, rc 0) 00000100:00100000:2.0:1789081555.932218:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:5569:x1875987796071040:12345-192.168.201.17@tcp:101: Request processed in 170us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081555.932227:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 165 00000100:00100000:2.0:1789081555.932255:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 166 00000100:00100000:2.0:1789081555.932261:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+9:2350:x1875987796071168:12345-192.168.201.17@tcp:400: 00000100:00100000:2.0:1789081555.932286:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+9:2350:x1875987796071168:12345-192.168.201.17@tcp:400: Request processed in 25us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081555.932292:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 166 00000100:00100000:2.0:1789081555.932319:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796071552 00000100:00100000:2.0:1789081555.932323:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796071552 00000100:00100000:2.0:1789081555.932358:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796071424 00000100:00100000:2.0:1789081555.932368:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796071424 00000100:00100000:2.0:1789081555.932390:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 14 00000100:00100000:2.0:1789081555.932396:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1100643100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41476931-e751-413e-b98c-64d4d0edcd05+5:2350:x1875987796071552:12345-192.168.201.17@tcp:400: 00000100:00100000:2.0:1789081555.932426:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1100643100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41476931-e751-413e-b98c-64d4d0edcd05+5:2350:x1875987796071552:12345-192.168.201.17@tcp:400: Request processed in 30us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081555.932432:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 14 00000100:00100000:2.0:1789081555.932443:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 15 00000100:00100000:2.0:1789081555.932449:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1100641f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41476931-e751-413e-b98c-64d4d0edcd05+5:2350:x1875987796071424:12345-192.168.201.17@tcp:400: 00000100:00100000:2.0:1789081555.932470:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1100641f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41476931-e751-413e-b98c-64d4d0edcd05+5:2350:x1875987796071424:12345-192.168.201.17@tcp:400: Request processed in 21us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081555.932475:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 15 00000100:00080000:2.0:1789081555.932649:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789081555.932653:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789081555.933000:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796071296 00000100:00100000:3.0:1789081555.933006:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796071296 00000100:00100000:3.0:1789081555.933052:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 33 00000100:00100000:3.0:1789081555.933060:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1100641180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+6:2350:x1875987796071296:12345-192.168.201.17@tcp:400: 00000100:00100000:3.0:1789081555.933099:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1100641180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+6:2350:x1875987796071296:12345-192.168.201.17@tcp:400: Request processed in 41us (1382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081555.933116:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 33 00000100:00080000:0.0:1789081555.933274:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789081555.939593:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081555.939693:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796071680 00000100:00100000:1.0:1789081555.939704:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796071680 00000100:00100000:1.0:1789081555.939760:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 167 00000100:00100000:1.0:1789081555.939770:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+9:5569:x1875987796071680:12345-192.168.201.17@tcp:501: 00000100:00100000:1.0:1789081555.940099:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+9:5569:x1875987796071680:12345-192.168.201.17@tcp:501: Request processed in 329us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081555.940108:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 167 00000100:00100000:3.0:1789081555.943149:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081555.943330:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796071808 00000100:00100000:0.0:1789081555.943342:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796071808 00000100:00100000:0.0:1789081555.943399:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 168 00000100:00100000:0.0:1789081555.943408:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+9:5569:x1875987796071808:12345-192.168.201.17@tcp:503: 00000100:00100000:0.0:1789081555.943682:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+9:5569:x1875987796071808:12345-192.168.201.17@tcp:503: Request processed in 274us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081555.943690:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 168 00000100:00100000:3.0:1789081555.948518:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081555.948705:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796071936 00000100:00100000:2.0:1789081555.948718:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796071936 00000100:00100000:2.0:1789081555.948783:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 169 00000100:00100000:2.0:1789081555.948804:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+9:6059:x1875987796071936:12345-192.168.201.17@tcp:502: 00000100:00100000:2.0:1789081555.949125:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+9:6059:x1875987796071936:12345-192.168.201.17@tcp:502: Request processed in 332us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081555.949135:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 169 00000100:00100000:2.0:1789081555.955599:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081555.955827:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796072064 00000100:00100000:1.0:1789081555.955840:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796072064 00000100:00100000:1.0:1789081555.955898:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 170 00000100:00100000:1.0:1789081555.955908:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+9:6059:x1875987796072064:12345-192.168.201.17@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789081555.956449:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+9:6059:x1875987796072064:12345-192.168.201.17@tcp:502:llog_process_th.0 Request processed in 541us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081555.956457:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 170 00000100:00100000:3.0:1789081555.962724:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081555.962901:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796072192 00000100:00100000:0.0:1789081555.962914:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796072192 00000100:00100000:0.0:1789081555.962979:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 171 00000100:00100000:0.0:1789081555.962990:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+9:5569:x1875987796072192:12345-192.168.201.17@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789081555.963008:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081555.963040:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10c1487c00/0xb7cb3d7479d5f790 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a793 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081555.963069:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10c1487c00/0xb7cb3d7479d5f790 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a793 expref: 10 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081555.963080:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10c1487c00/0xb7cb3d7479d5f790 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a793 expref: 10 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081555.963099:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10c1487c00, rc 0) 00000100:00100000:0.0:1789081555.963165:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:5569:x1875987796072192:12345-192.168.201.17@tcp:101:ll_cfg_requeue.0 Request processed in 176us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081555.963312:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 171 00000100:00100000:3.0:1789081555.971726:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081555.973600:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796072320 00000100:00100000:2.0:1789081555.973615:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796072320 00000100:00100000:2.0:1789081555.973687:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 172 00000100:00100000:2.0:1789081555.973697:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:5569:x1875987796072320:12345-192.168.201.17@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789081555.974008:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:5569:x1875987796072320:12345-192.168.201.17@tcp:501:ll_cfg_requeue.0 Request processed in 311us (2294us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789081555.974016:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 172 00010000:00010000:0.0:1789081556.764714:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789081557.217147:0:8361:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff715b1d20 20000000:00000080:1.0:1789081557.217179:0:8361:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e10ff59fc00 uarg=0000000000000000 20000000:01000000:1.0:1789081557.217216:0:8361:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789081557.217221:0:8361:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789081557.217226:0:8361:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789081557.218955:0:8362:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1789081557.219126:0:8361:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1789081557.231845:0:8361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1789081557.231905:0:8361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1789081557.232264:0:8361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1789081557.232287:0:8361:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789081557.232309:0:8361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e10c1486e00/0xb7cb3d7479d5f797 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081557.232325:0:8361:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e10e13afa00/0xb7cb3d7479d5f50c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f505 expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081557.232330:0:8361:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e10e13afe00/0xb7cb3d7479d5f56e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f567 expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081557.232335:0:8361:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e10c0031000/0xb7cb3d7479d5f639 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f632 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081557.232342:0:8361:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e1101998200/0xb7cb3d7479d5f6f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a75b expref: 9 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081557.232347:0:8361:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e10c1486e00/0xb7cb3d7479d5f797 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081557.232437:0:8361:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e1101998200/0xb7cb3d7479d5f6f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a75b expref: 9 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081557.232494:0:8361:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e1101998200/0xb7cb3d7479d5f6f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a75b expref: 9 pid: 5782 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081557.232518:0:8361:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b30e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8361:1875987821266048:192.168.201.17@tcp:104: 00010000:00010000:0.0:1789081557.232662:0:8361:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e10c0031000/0xb7cb3d7479d5f639 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb7cb3d7479d5f632 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081557.232668:0:8361:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e10c0031000/0xb7cb3d7479d5f639 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f632 expref: 18 pid: 5783 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081557.232676:0:8361:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b33b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8361:1875987821266176:0@lo:104: 00000100:00100000:0.0:1789081557.232725:0:8361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789081557.233150:0:8361:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e10e13afe00/0xb7cb3d7479d5f56e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb7cb3d7479d5f567 expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081557.233170:0:8361:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e10e13afe00/0xb7cb3d7479d5f56e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f567 expref: 18 pid: 5782 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081557.233180:0:8361:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b33800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8361:1875987821266304:0@lo:104: 00000100:00100000:3.0:1789081557.233359:0:5772:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789081557.236024:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081557.236068:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821266176 00000100:00100000:3.0:1789081557.236079:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821266176 00000100:00100000:3.0:1789081557.236140:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821266304 00000100:00100000:3.0:1789081557.236144:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821266304 00000100:00100000:3.0:1789081557.236194:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789081557.236205:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101846c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+4:8361:x1875987821266176:12345-0@lo:104: 00010000:00010000:3.0:1789081557.236227:0:5772:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1c00/0xb7cb3d7479d5f632 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f639 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081557.236300:0:5772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789081557.236306:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101846c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+4:8361:x1875987821266176:12345-0@lo:104: Request processed in 104us (3579us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081557.236315:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1789081557.237007:0:8361:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e10e13afa00/0xb7cb3d7479d5f50c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb7cb3d7479d5f505 expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081557.237025:0:8361:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e10e13afa00/0xb7cb3d7479d5f50c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f505 expref: 18 pid: 5782 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081557.237043:0:8361:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b32a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8361:1875987821266432:0@lo:104: 00000100:00100000:0.0:1789081557.237091:0:8361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081557.237117:0:8361:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c8810a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789081557.237146:0:8361:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b33b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8361:1875987821266176:0@lo:104: 00010000:00010000:0.0:1789081557.239337:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789081557.239363:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1c00/0xb7cb3d7479d5f632 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f639 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081557.239387:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10c29e1c00 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:0.0:1789081557.239392:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1c00/0xb7cb3d7479d5f632 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb7cb3d7479d5f639 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081557.239404:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1c00/0xb7cb3d7479d5f632 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb7cb3d7479d5f639 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789081557.239412:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1c00/0xb7cb3d7479d5f632 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb7cb3d7479d5f639 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789081557.239419:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789081557.239486:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1c00/0xb7cb3d7479d5f632 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f639 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081557.239493:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789081557.239561:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1c00/0xb7cb3d7479d5f632 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f639 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081557.239569:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821266432 00010000:00010000:0.0:1789081557.239570:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1c00/0xb7cb3d7479d5f632 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f639 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081557.239580:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821266432 00010000:00010000:0.0:1789081557.239586:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081557.239589:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081557.239592:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789081557.239629:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789081557.239646:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+4:8361:x1875987821266304:12345-0@lo:104: 00010000:00010000:1.0:1789081557.239658:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.117@tcp lock: ffff9e1102044400/0xb7cb3d7479d5f567 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f56e expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081557.239753:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789081557.239759:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+4:8361:x1875987821266304:12345-0@lo:104: Request processed in 116us (3747us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081557.239766:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789081557.239787:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789081557.239794:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+3:8361:x1875987821266432:12345-0@lo:104: 00010000:00010000:1.0:1789081557.239801:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae400/0xb7cb3d7479d5f505 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f50c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081557.239836:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789081557.239842:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+3:8361:x1875987821266432:12345-0@lo:104: Request processed in 49us (2752us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081557.239848:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:1.0:1789081557.239870:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789081557.239875:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e1102044400/0xb7cb3d7479d5f567 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f56e expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081557.239882:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1102044400 already unused, calling callback (ffffffffc1d6ac20) 00000100:00100000:0.0:1789081557.239884:0:8361:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b33800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8361:1875987821266304:0@lo:104: 10000000:00010000:1.0:1789081557.239886:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e1102044400/0xb7cb3d7479d5f567 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb7cb3d7479d5f56e expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081557.239897:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e1102044400/0xb7cb3d7479d5f567 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb7cb3d7479d5f56e expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081557.239901:0:8361:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b32a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8361:1875987821266432:0@lo:104: 10000000:00010000:1.0:1789081557.239908:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e1102044400/0xb7cb3d7479d5f567 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb7cb3d7479d5f56e expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789081557.239921:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789081557.239936:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e1102044400/0xb7cb3d7479d5f567 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f56e expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081557.239942:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789081557.240029:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821266688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789081557.240077:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081557.240429:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789081557.240442:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee551687-7675-4fc6-9be1-2ccb62bdd809:3303:1875987821266560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789081557.240493:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081557.240535:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821266688 00000100:00100000:2.0:1789081557.240540:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821266688 00010000:00010000:2.0:1789081557.240575:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e10e13afe00/0xb7cb3d7479d5f56e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f567 expref: 19 pid: 5782 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081557.240600:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821266560 00000100:00100000:2.0:1789081557.240603:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821266560 00010000:00010000:2.0:1789081557.240617:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e10c0031000/0xb7cb3d7479d5f639 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f632 expref: 20 pid: 5783 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081557.240647:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789081557.240655:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+20:3305:x1875987821266688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789081557.240666:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789081557.240672:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e10e13afe00/0xb7cb3d7479d5f56e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f567 expref: 20 pid: 5782 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081557.240681:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e10e13afe00/0xb7cb3d7479d5f56e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f567 expref: 20 pid: 5782 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081557.240698:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10e13afe00/0xb7cb3d7479d5f56e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb7cb3d7479d5f567 expref: 20 pid: 5782 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081557.240712:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789081557.240825:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789081557.240833:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9484700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3303:x1875987821266560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789081557.240840:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081557.240844:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e10c0031000/0xb7cb3d7479d5f639 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f632 expref: 19 pid: 5783 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081557.240855:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e10c0031000/0xb7cb3d7479d5f639 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f632 expref: 19 pid: 5783 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081557.240869:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10c0031000/0xb7cb3d7479d5f639 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb7cb3d7479d5f632 expref: 19 pid: 5783 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081557.240877:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789081557.240908:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9484700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:3303:x1875987821266560:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081557.240916:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:1.0:1789081557.241915:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e1102044400/0xb7cb3d7479d5f567 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f56e expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081557.241930:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e1102044400/0xb7cb3d7479d5f567 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f56e expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081557.241945:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789081557.241949:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae400/0xb7cb3d7479d5f505 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f50c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081557.241954:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13ae400 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:1.0:1789081557.241958:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae400/0xb7cb3d7479d5f505 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb7cb3d7479d5f50c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081557.241966:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae400/0xb7cb3d7479d5f505 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb7cb3d7479d5f50c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789081557.241973:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae400/0xb7cb3d7479d5f505 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb7cb3d7479d5f50c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789081557.241978:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789081557.242010:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae400/0xb7cb3d7479d5f505 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f50c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081557.242016:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789081557.242079:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821266816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789081557.242123:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081557.244223:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081557.244305:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821266816 00000100:00100000:3.0:1789081557.244317:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821266816 00010000:00010000:3.0:1789081557.244363:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e10e13afa00/0xb7cb3d7479d5f50c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f505 expref: 18 pid: 5782 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081557.246116:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796072448 00000100:00100000:3.0:1789081557.246131:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796072448 00010000:00010000:3.0:1789081557.246359:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e1101998200/0xb7cb3d7479d5f6f6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a75b expref: 10 pid: 5782 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081557.246394:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789081557.246404:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:3306:x1875987821266816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789081557.246420:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081557.246426:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e10e13afa00/0xb7cb3d7479d5f50c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f505 expref: 18 pid: 5782 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081557.246437:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e10e13afa00/0xb7cb3d7479d5f50c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f505 expref: 18 pid: 5782 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081557.246654:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10e13afa00/0xb7cb3d7479d5f50c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb7cb3d7479d5f505 expref: 18 pid: 5782 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081557.246671:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789081557.246751:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:3306:x1875987821266816:12345-0@lo:103:ldlm_bl.0 Request processed in 350us (4628us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081557.246760:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789081557.246912:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 24 00000100:00100000:3.0:1789081557.246920:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:2350:x1875987796072448:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789081557.246930:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081557.246935:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e1101998200/0xb7cb3d7479d5f6f6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a75b expref: 10 pid: 5782 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081557.246945:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e1101998200/0xb7cb3d7479d5f6f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a75b expref: 10 pid: 5782 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081557.247180:0:7481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e10c1486e00/0xb7cb3d7479d5f797 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081557.247258:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:3305:x1875987821266688:12345-0@lo:103:ldlm_bl.0 Request processed in 6601us (7177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081557.247268:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789081557.247276:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821266688:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789081557.247334:0:8361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e1101998200/0xb7cb3d7479d5f6f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a75b expref: 10 pid: 5782 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081557.247347:0:8361:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b30e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8361:1875987821266048:192.168.201.17@tcp:104: 00010000:00010000:1.0:1789081557.247369:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae400/0xb7cb3d7479d5f505 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f50c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081557.247380:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae400/0xb7cb3d7479d5f505 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f50c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081557.247399:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081557.247403:0:7481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10c1486e00/0xb7cb3d7479d5f797 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081557.247403:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081557.247406:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081557.247415:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789081557.247469:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee551687-7675-4fc6-9be1-2ccb62bdd809:3303:1875987821266560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789081557.248503:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821266816:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789081557.249898:0:8361:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e10c1486e00/0xb7cb3d7479d5f797 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081557.250608:0:7481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e10c1486e00/0xb7cb3d7479d5f797 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081557.250617:0:7481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e10c1486e00/0xb7cb3d7479d5f797 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081557.250622:0:7481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e10c1486e00/0xb7cb3d7479d5f797 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081557.250646:0:7481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e10c1486e00/0xb7cb3d7479d5f797 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081557.250651:0:7481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10c1486e00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:3.0:1789081557.250654:0:7481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e10c1486e00/0xb7cb3d7479d5f797 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081557.250659:0:7481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e10c1486e00/0xb7cb3d7479d5f797 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081557.250678:0:7481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e10c1486e00/0xb7cb3d7479d5f797 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081557.250691:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789081557.250866:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+9:2350:x1875987796072448:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 3842us (6551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081557.250876:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 24 00010000:00010000:0.0:1789081557.250986:0:8361:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e10c1486e00/0xb7cb3d7479d5f797 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081557.250995:0:8361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e10c1486e00/0xb7cb3d7479d5f797 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081557.251002:0:8361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10c1486e00/0xb7cb3d7479d5f797 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081557.304008:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081557.304086:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796072576 00000100:00100000:3.0:1789081557.304098:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796072576 00000100:00100000:3.0:1789081557.304167:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 173 00000100:00100000:3.0:1789081557.304178:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+9:5569:x1875987796072576:12345-192.168.201.17@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789081557.304195:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081557.304215:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e1101998e00/0xb7cb3d7479d5f79e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a79a expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081557.304251:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e1101998e00/0xb7cb3d7479d5f79e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a79a expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081557.304288:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e1101998e00/0xb7cb3d7479d5f79e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a79a expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081557.304299:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101998e00, rc 0) 00000100:00100000:3.0:1789081557.304358:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:5569:x1875987796072576:12345-192.168.201.17@tcp:101:ll_cfg_requeue.0 Request processed in 182us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081557.304366:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 173 00000100:00100000:0.0:1789081557.327959:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081557.331247:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796072704 00000100:00100000:3.0:1789081557.331267:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796072704 00000100:00100000:3.0:1789081557.331341:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 174 00000100:00100000:3.0:1789081557.331353:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:5569:x1875987796072704:12345-192.168.201.17@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789081557.334338:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:5569:x1875987796072704:12345-192.168.201.17@tcp:501:ll_cfg_requeue.0 Request processed in 2972us (6377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081557.334353:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 174 00000100:00100000:3.0:1789081557.347038:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081557.347249:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796072832 00000100:00100000:2.0:1789081557.347262:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796072832 00000100:00100000:2.0:1789081557.347328:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 175 00000100:00100000:2.0:1789081557.347339:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:5569:x1875987796072832:12345-192.168.201.17@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789081557.347860:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:5569:x1875987796072832:12345-192.168.201.17@tcp:503:ll_cfg_requeue.0 Request processed in 520us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081557.347869:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 175 00000100:00100000:3.0:1789081557.367392:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081557.367564:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796072960 00000100:00100000:1.0:1789081557.367578:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796072960 00000100:00100000:1.0:1789081557.367645:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 176 00000100:00100000:1.0:1789081557.367656:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:6079:x1875987796072960:12345-192.168.201.17@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789081557.367948:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:6079:x1875987796072960:12345-192.168.201.17@tcp:502:llog_process_th.0 Request processed in 293us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081557.367969:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 176 00000100:00100000:1.0:1789081557.379760:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081557.380312:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796073088 00000100:00100000:0.0:1789081557.380328:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796073088 00000100:00100000:0.0:1789081557.380415:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 177 00000100:00100000:0.0:1789081557.380428:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ffa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:6079:x1875987796073088:12345-192.168.201.17@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789081557.381261:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ffa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:6079:x1875987796073088:12345-192.168.201.17@tcp:502:llog_process_th.0 Request processed in 833us (1511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081557.381272:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 177 00010000:00010000:1.0:1789081557.788995:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081557.852772:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789081557.852796:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821266944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789081557.852867:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081557.853039:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821266944 00000100:00100000:0.0:1789081557.853069:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821266944 00000100:00100000:0.0:1789081557.853128:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789081557.853137:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821266944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789081557.853189:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789081557.853238:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821266944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081557.853246:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1789081557.853269:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789081557.853475:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10d1b30e00 x1875987821266944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081573 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789081557.853496:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821266944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789081558.367505:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821267072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789081558.367613:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081558.367843:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821267072 00000100:00100000:3.0:1789081558.367850:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821267072 00000100:00100000:3.0:1789081558.370723:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789081558.370742:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9485180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821267072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789081558.370789:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789081558.370879:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9485180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821267072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 146us (3266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081558.370887:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1789081558.370947:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10f5c7a680 x1875987821267072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081574 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789081558.370967:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821267072:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789081558.375597:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789081558.379120:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821267200:0@lo:400:kworker.0 00000100:00100000:0.0:1789081558.379128:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875987821267328:0@lo:400:kworker.0 00000100:00100000:3.0:1789081558.379471:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875987821267456:0@lo:400:kworker.0 00000100:00100000:2.0:1789081558.384423:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081558.385258:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875987821267712:0@lo:400:kworker.0 00000100:00100000:2.0:1789081558.385864:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081558.386720:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081558.386850:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821267584:0@lo:400:kworker.0 00000100:00100000:0.0:1789081558.387031:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081558.387182:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821267200 00000100:00100000:2.0:1789081558.387196:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821267200 00000100:00100000:0.0:1789081558.387217:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821267584 00000100:00100000:0.0:1789081558.387226:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821267584 00000100:00100000:2.0:1789081558.387279:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789081558.387301:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789081558.387302:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:3305:x1875987821267200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081558.387319:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821267584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081558.387470:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821267584:12345-0@lo:400:kworker.0 Request processed in 156us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081558.387479:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1789081558.387557:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10d1b32300 x1875987821267584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789081574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081558.387574:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821267584:0@lo:400:kworker.0 00000100:00100000:2.0:1789081558.388618:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:3305:x1875987821267200:12345-0@lo:400:kworker.0 Request processed in 1320us (4193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081558.388647:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789081558.388874:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081558.401936:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821267712 00000100:00100000:1.0:1789081558.401957:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821267712 00000100:00100000:1.0:1789081558.402068:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821267328 00000100:00100000:1.0:1789081558.402072:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821267328 00000100:00100000:1.0:1789081558.402092:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821267456 00000100:00100000:1.0:1789081558.402095:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821267456 00000100:00100000:1.0:1789081558.402122:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789081558.402145:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875987821267712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081558.402282:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875987821267712:12345-0@lo:400:kworker.0 Request processed in 150us (16418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081558.402312:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789081558.402335:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789081558.402340:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875987821267328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081558.402388:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875987821267328:12345-0@lo:400:kworker.0 Request processed in 48us (15678us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081558.402394:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789081558.402406:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789081558.402413:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875987821267456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081558.402452:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875987821267456:12345-0@lo:400:kworker.0 Request processed in 41us (13581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081558.402457:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789081558.403453:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875987821267328:0@lo:400:kworker.0 00000100:00080000:2.0:1789081558.406099:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789081558.407707:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821267200:0@lo:400:kworker.0 00000100:00100000:0.0:1789081558.407749:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875987821267712:0@lo:400:kworker.0 00000100:00100000:3.0:1789081558.407946:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875987821267456:0@lo:400:kworker.0 00010000:00010000:2.0:1789081558.812710:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789081558.958982:0:5786:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789081558.958992:0:5786:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e10ff7e6800 from 4 10000000:01000000:2.0:1789081558.958997:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789081558.959066:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0400/0xb7cb3d7479d5f7a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081558.959079:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0400/0xb7cb3d7479d5f7a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081558.959090:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0400/0xb7cb3d7479d5f7a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081558.959116:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff5ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821267840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789081558.959204:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081558.959271:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e11010abc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789081558.960586:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821267840 00000100:00100000:3.0:1789081558.960597:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821267840 00000100:00100000:3.0:1789081558.960655:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789081558.960664:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:5786:x1875987821267840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789081558.960681:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081558.960698:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e1101999000/0xb7cb3d7479d5f7ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f7a5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081558.960727:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e1101999000/0xb7cb3d7479d5f7ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f7a5 expref: 17 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081558.960738:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e1101999000/0xb7cb3d7479d5f7ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f7a5 expref: 17 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081558.960747:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101999000, rc 0) 00000100:00100000:3.0:1789081558.960820:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:5786:x1875987821267840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (1616us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081558.960827:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789081558.960884:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff5ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821267840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789081558.960901:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0400/0xb7cb3d7479d5f7a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f7ac expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081558.960910:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0400/0xb7cb3d7479d5f7a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f7ac expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081558.960984:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c79f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821267968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789081558.961015:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081558.961036:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c8e839c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789081558.961049:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821267968 00000100:00100000:3.0:1789081558.961053:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821267968 00000100:00100000:3.0:1789081558.961075:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789081558.961081:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:5786:x1875987821267968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789081558.961336:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:5786:x1875987821267968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 254us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081558.961343:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789081558.961375:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c79f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821267968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789081558.961402:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c79f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821268096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789081558.961438:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081558.962846:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c8e839c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789081558.962873:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821268096 00000100:00100000:3.0:1789081558.962881:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821268096 00000100:00100000:3.0:1789081558.962947:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789081558.962956:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:5786:x1875987821268096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789081558.963240:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:5786:x1875987821268096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 284us (1801us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081558.963248:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789081558.977159:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c79f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821268096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789081558.977609:0:8424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b32680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:8424:1875987821268224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789081558.977685:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081558.977727:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821268224 00000100:00100000:0.0:1789081558.977733:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821268224 00000100:00100000:0.0:1789081558.977777:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789081558.977786:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:8424:x1875987821268224:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789081558.978016:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:8424:x1875987821268224:12345-0@lo:502:llog_process_th.0 Request processed in 230us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081558.978024:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789081558.978085:0:8424:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c88109c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789081558.978102:0:8424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b32680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:8424:1875987821268224:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789081558.978136:0:8424:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789081558.978147:0:8424:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789081558.978149:0:8424:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789081558.978156:0:8424:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e10ff7e6800 00000020:00000080:0.0:1789081558.978158:0:8424:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789081558.978245:0:8424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b32680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:8424:1875987821268352:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789081558.980618:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081558.980660:0:8424:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c88109c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789081558.981619:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821268352 00000100:00100000:0.0:1789081558.981630:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821268352 00000100:00100000:0.0:1789081558.981676:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789081558.981684:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ffb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:8424:x1875987821268352:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789081558.981920:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ffb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:8424:x1875987821268352:12345-0@lo:502:llog_process_th.0 Request processed in 236us (1307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081558.981928:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789081558.981996:0:8424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b32680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:8424:1875987821268352:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789081558.982026:0:8424:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789081558.982033:0:8424:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789081558.982035:0:8424:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789081558.982040:0:8424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789081558.982096:0:5786:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789081558.982111:0:5786:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789081558.982133:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0400/0xb7cb3d7479d5f7a5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f7ac expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081558.982145:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0400/0xb7cb3d7479d5f7a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f7ac expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789081558.982156:0:5786:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789081558.982159:0:5786:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e10fad3e000 from 4 10000000:01000000:0.0:1789081558.982161:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789081558.982191:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c1486e00/0xb7cb3d7479d5f7b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081558.982200:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e10c1486e00/0xb7cb3d7479d5f7b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081558.982210:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e10c1486e00/0xb7cb3d7479d5f7b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081558.982227:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821268480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789081558.982257:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081558.982284:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c88109c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789081558.982295:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821268480 00000100:00100000:0.0:1789081558.982298:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821268480 00000100:00100000:0.0:1789081558.982323:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789081558.982328:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:5786:x1875987821268480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789081558.982336:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081558.982347:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10c1486400/0xb7cb3d7479d5f7ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f7b3 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081558.982367:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10c1486400/0xb7cb3d7479d5f7ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f7b3 expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081558.982377:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10c1486400/0xb7cb3d7479d5f7ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f7b3 expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081558.982386:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10c1486400, rc 0) 00000100:00100000:0.0:1789081558.982408:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:5786:x1875987821268480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081558.982414:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789081558.982437:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821268480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789081558.984876:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e10c1486e00/0xb7cb3d7479d5f7b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f7ba expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081558.984895:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e10c1486e00/0xb7cb3d7479d5f7b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f7ba expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081558.984976:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821268608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789081558.985035:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081558.988224:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c88109c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789081558.998163:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821268608 00000100:00100000:1.0:1789081558.998184:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821268608 00000100:00100000:1.0:1789081558.998267:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789081558.998278:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:5786:x1875987821268608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789081558.998770:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:5786:x1875987821268608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 492us (13731us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081558.998778:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789081558.998843:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821268608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789081558.998893:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821268736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789081558.998933:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081558.998963:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d17d3480 going to sleep for 11 seconds 00000100:00100000:1.0:1789081558.998976:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821268736 00000100:00100000:1.0:1789081558.998985:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821268736 00000100:00100000:1.0:1789081558.999005:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789081558.999010:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ff8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:5786:x1875987821268736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789081559.000076:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ff8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:5786:x1875987821268736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1060us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081559.000089:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789081559.000167:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821268736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789081559.019712:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:8427:1875987821268864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789081559.019850:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081559.019895:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821268864 00000100:00100000:1.0:1789081559.019903:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821268864 00000100:00100000:1.0:1789081559.019955:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789081559.019966:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ff9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:8427:x1875987821268864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789081559.020236:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ff9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:8427:x1875987821268864:12345-0@lo:502:llog_process_th.0 Request processed in 270us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081559.020244:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789081559.020300:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d17d3480 going to sleep for 11 seconds 00000100:00100000:1.0:1789081559.020324:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:8427:1875987821268864:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789081559.020353:0:8427:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789081559.020365:0:8427:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789081559.020368:0:8427:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789081559.020375:0:8427:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e10fad3e000 00000020:00000080:1.0:1789081559.020377:0:8427:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789081559.020453:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:8427:1875987821268992:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789081559.020483:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081559.020502:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821268992 00000100:00100000:1.0:1789081559.020512:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821268992 00000100:00100000:1.0:1789081559.020553:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789081559.020559:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ffac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:8427:x1875987821268992:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789081559.020658:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ffac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:8427:x1875987821268992:12345-0@lo:502:llog_process_th.0 Request processed in 98us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081559.020664:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789081559.020696:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d17d3480 going to sleep for 11 seconds 00000100:00100000:1.0:1789081559.020707:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:8427:1875987821268992:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789081559.020723:0:8427:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789081559.020727:0:8427:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789081559.020729:0:8427:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789081559.020732:0:8427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789081559.020790:0:5786:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789081559.020811:0:5786:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789081559.020823:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c1486e00/0xb7cb3d7479d5f7b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f7ba expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081559.020834:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e10c1486e00/0xb7cb3d7479d5f7b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f7ba expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789081559.020846:0:5786:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789081559.020849:0:5786:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e10ee974800 from 4 10000000:01000000:1.0:1789081559.020851:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789081559.020876:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10e13aec00/0xb7cb3d7479d5f7c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081559.020884:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e10e13aec00/0xb7cb3d7479d5f7c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081559.020893:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e10e13aec00/0xb7cb3d7479d5f7c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081559.020911:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821269120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789081559.020938:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081559.020953:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d17d3480 going to sleep for 11 seconds 00000100:00100000:1.0:1789081559.020965:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821269120 00000100:00100000:1.0:1789081559.020970:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821269120 00000100:00100000:1.0:1789081559.020991:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789081559.020997:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:5786:x1875987821269120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789081559.021005:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081559.021017:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10e13af600/0xb7cb3d7479d5f7c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f7c1 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081559.021035:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10e13af600/0xb7cb3d7479d5f7c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f7c1 expref: 19 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081559.021045:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10e13af600/0xb7cb3d7479d5f7c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f7c1 expref: 19 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081559.021053:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13af600, rc 0) 00000100:00100000:1.0:1789081559.021079:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:5786:x1875987821269120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081559.021084:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789081559.021110:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821269120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789081559.021140:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e10e13aec00/0xb7cb3d7479d5f7c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f7c8 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081559.021149:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e10e13aec00/0xb7cb3d7479d5f7c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f7c8 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081559.021194:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821269248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789081559.021216:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081559.021227:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d17d3480 going to sleep for 11 seconds 00000100:00100000:1.0:1789081559.021238:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821269248 00000100:00100000:1.0:1789081559.021241:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821269248 00000100:00100000:1.0:1789081559.021260:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789081559.021265:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:5786:x1875987821269248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789081559.021481:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:5786:x1875987821269248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 214us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081559.021488:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1789081559.024013:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821269248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789081559.024082:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821269376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789081559.024169:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081559.024218:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c30140c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789081559.028750:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821269376 00000100:00100000:1.0:1789081559.028767:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821269376 00000100:00100000:1.0:1789081559.028828:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789081559.028837:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:5786:x1875987821269376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789081559.029079:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:5786:x1875987821269376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 242us (4910us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081559.029089:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789081559.029176:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821269376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789081559.036803:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c7aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:8428:1875987821269504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789081559.036899:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081559.036951:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c30140c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789081559.037161:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821269504 00000100:00100000:1.0:1789081559.037170:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821269504 00000100:00100000:1.0:1789081559.037226:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1789081559.037236:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:8428:x1875987821269504:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789081559.037487:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:8428:x1875987821269504:12345-0@lo:502:llog_process_th.0 Request processed in 251us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081559.037504:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1789081559.038005:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c7aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:8428:1875987821269504:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789081559.038039:0:8428:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789081559.038049:0:8428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789081559.038051:0:8428:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789081559.038060:0:8428:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e10ee974800 00000020:00000080:3.0:1789081559.038062:0:8428:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789081559.038162:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c7aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:8428:1875987821269632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789081559.038204:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081559.038235:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c30140c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789081559.039230:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821269632 00000100:00100000:1.0:1789081559.039244:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821269632 00000100:00100000:1.0:1789081559.039288:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789081559.039296:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:8428:x1875987821269632:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789081559.039708:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:8428:x1875987821269632:12345-0@lo:502:llog_process_th.0 Request processed in 411us (1502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081559.039716:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1789081559.039966:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c7aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:8428:1875987821269632:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789081559.039996:0:8428:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789081559.040003:0:8428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789081559.040006:0:8428:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789081559.040016:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789081559.040875:0:5786:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789081559.040900:0:5786:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789081559.040911:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10e13aec00/0xb7cb3d7479d5f7c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f7c8 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081559.040923:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e10e13aec00/0xb7cb3d7479d5f7c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f7c8 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081559.838676:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081560.860766:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789081561.052082:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081561.052139:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081561.052165:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081561.052200:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081561.052235:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796073344 00000100:00100000:1.0:1789081561.052247:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796073344 00000100:00100000:1.0:1789081561.052330:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 37 00000100:00100000:1.0:1789081561.052343:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11006a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+6:2348:x1875987796073344:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:1.0:1789081561.052446:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11006a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+6:2348:x1875987796073344:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 105us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081561.052479:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 37 00000100:00100000:1.0:1789081561.052546:0:7788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796073472 00000100:00100000:1.0:1789081561.052551:0:7788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796073472 00000100:00100000:1.0:1789081561.052581:0:7788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796073600 00000100:00100000:1.0:1789081561.052585:0:7788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796073600 00000100:00100000:1.0:1789081561.052607:0:7788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 17 00000100:00100000:1.0:1789081561.052613:0:7788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11006a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41476931-e751-413e-b98c-64d4d0edcd05+5:2348:x1875987796073472:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:1.0:1789081561.052642:0:7788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11006a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41476931-e751-413e-b98c-64d4d0edcd05+5:2348:x1875987796073472:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 28us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081561.052648:0:7788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 17 00000100:00100000:1.0:1789081561.052660:0:7788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 18 00000100:00100000:1.0:1789081561.052666:0:7788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11006a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41476931-e751-413e-b98c-64d4d0edcd05+5:2348:x1875987796073600:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:1.0:1789081561.052687:0:7788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11006a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41476931-e751-413e-b98c-64d4d0edcd05+5:2348:x1875987796073600:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 22us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081561.052694:0:7788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 18 00000100:00080000:1.0:1789081561.052711:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789081561.052717:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789081561.052720:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789081561.054339:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796073216 00000100:00100000:3.0:1789081561.054357:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796073216 00000100:00100000:3.0:1789081561.054440:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 194 00000100:00100000:3.0:1789081561.054450:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:2348:x1875987796073216:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081561.054573:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:2348:x1875987796073216:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 123us (2503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081561.054582:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 194 00010000:00010000:0.0:1789081561.887807:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081562.917570:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789081562.979322:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821269760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789081562.979419:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081562.980723:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821269760 00000100:00100000:3.0:1789081562.980738:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821269760 00000100:00100000:3.0:1789081562.980830:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789081562.980842:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821269760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789081562.980893:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789081562.981376:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821269760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 526us (1947us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081562.981391:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1789081562.981434:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10d1b32a00 x1875987821269760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081578 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789081562.981466:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821269760:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789081562.982344:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789081563.484737:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875987821270016:0@lo:400:kworker.0 00000100:00100000:0.0:1789081563.484831:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081563.484910:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821270528:0@lo:400:kworker.0 00000100:00100000:0.0:1789081563.484938:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081563.484984:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789081563.484990:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821269888:0@lo:400:kworker.0 00000100:00100000:0.0:1789081563.485022:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081563.485055:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875987821270400:0@lo:400:kworker.0 00000100:00100000:0.0:1789081563.485078:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081563.485106:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875987821270144:0@lo:400:kworker.0 00000100:00100000:0.0:1789081563.485131:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081563.485151:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789081563.485156:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821270272:0@lo:400:kworker.0 00000100:00100000:0.0:1789081563.485180:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081563.485217:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821270016 00000100:00100000:0.0:1789081563.485227:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821270016 00000100:00100000:0.0:1789081563.485279:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821270400 00000100:00100000:0.0:1789081563.485283:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821270400 00000100:00100000:0.0:1789081563.485310:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821270144 00000100:00100000:0.0:1789081563.485313:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821270144 00000100:00100000:0.0:1789081563.485331:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789081563.485339:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875987821270016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081563.485398:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875987821270016:12345-0@lo:400:kworker.0 Request processed in 59us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081563.485405:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789081563.485438:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789081563.485443:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875987821270400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081563.485472:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875987821270400:12345-0@lo:400:kworker.0 Request processed in 29us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081563.485478:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789081563.485488:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789081563.485493:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875987821270144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081563.485546:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875987821270144:12345-0@lo:400:kworker.0 Request processed in 29us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081563.485552:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789081563.485571:0:7788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821270528 00000100:00100000:0.0:1789081563.485574:0:7788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821270528 00000100:00100000:0.0:1789081563.485600:0:7788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821270272 00000100:00100000:0.0:1789081563.485603:0:7788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821270272 00000100:00100000:0.0:1789081563.485619:0:7788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789081563.485626:0:7788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821270528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081563.485655:0:7788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821270528:12345-0@lo:400:kworker.0 Request processed in 30us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081563.485661:0:7788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789081563.485671:0:7788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789081563.485677:0:7788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821270272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081563.485703:0:7788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821270272:12345-0@lo:400:kworker.0 Request processed in 26us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081563.485708:0:7788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789081563.485726:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821269888 00000100:00100000:0.0:1789081563.485729:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821269888 00000100:00100000:0.0:1789081563.485756:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1789081563.485769:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3304:x1875987821269888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081563.485801:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3304:x1875987821269888:12345-0@lo:400:kworker.0 Request processed in 33us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081563.485808:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:0.0:1789081563.485850:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789081563.485856:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789081563.485897:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10d1b33b80 x1875987821270272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789081579 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081563.485914:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821270272:0@lo:400:kworker.0 00000100:00100000:0.0:1789081563.485925:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875987821270144:0@lo:400:kworker.0 00000100:00100000:0.0:1789081563.485958:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821269888:0@lo:400:kworker.0 00000100:00100000:0.0:1789081563.485968:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875987821270400:0@lo:400:kworker.0 00000100:00100000:0.0:1789081563.485979:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875987821270016:0@lo:400:kworker.0 00010000:00080000:0.0:1789081563.485988:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10d1b30e00 x1875987821270528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789081579 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081563.485998:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821270528:0@lo:400:kworker.0 00000100:00100000:0.0:1789081563.486418:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789081563.486430:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821270656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789081563.486469:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081563.486578:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821270656 00000100:00100000:3.0:1789081563.486584:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821270656 00000100:00100000:3.0:1789081563.486627:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789081563.486635:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821270656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789081563.486669:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789081563.486715:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821270656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081563.486723:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1789081563.486754:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e11010b5500 x1875987821270656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081579 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789081563.486771:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821270656:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789081563.938309:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789081564.812341:0:8660:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg117-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1789081564.964478:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081565.996273:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789081566.186248:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081566.186300:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081566.186324:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081566.186391:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081566.186584:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796073728 00000100:00100000:3.0:1789081566.186596:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796073728 00000100:00100000:3.0:1789081566.186661:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 196 00000100:00100000:3.0:1789081566.186672:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:2350:x1875987796073728:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081566.186751:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:2350:x1875987796073728:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 80us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081566.186759:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 196 00000100:00100000:0.0:1789081566.187669:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796073856 00000100:00100000:0.0:1789081566.187679:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796073856 00000100:00100000:0.0:1789081566.187741:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 41 00000100:00100000:0.0:1789081566.187750:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11006a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+6:2350:x1875987796073856:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:0.0:1789081566.187831:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11006a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+6:2350:x1875987796073856:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 82us (1530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081566.187839:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 41 00000100:00100000:0.0:1789081566.187862:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796073984 00000100:00100000:0.0:1789081566.187866:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796073984 00000100:00100000:0.0:1789081566.187905:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796074112 00000100:00100000:0.0:1789081566.187909:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796074112 00000100:00100000:0.0:1789081566.187942:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 10 00000100:00100000:0.0:1789081566.187950:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11006a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+5:2347:x1875987796073984:12345-192.168.201.17@tcp:9:kworker.0 00000020:00000080:0.0:1789081566.187991:0:6584:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb7cb3d7479d5f704 00000100:00080000:0.0:1789081566.188012:0:6584:0:(import.c:65:import_set_state_nolock()) ffff9e110161e000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789081566.188063:0:6584:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:1.0:1789081566.188558:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789081566.188563:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789081566.188566:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789081566.188826:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11006a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+2:2347:x1875987796073984:12345-192.168.201.17@tcp:9:kworker.0 Request processed in 874us (2498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081566.188835:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 10 00000100:00100000:0.0:1789081566.188855:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 11 00000100:00100000:0.0:1789081566.188863:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11006a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+5:2347:x1875987796074112:12345-192.168.201.17@tcp:9:kworker.0 00000020:00000080:0.0:1789081566.188881:0:6584:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb7cb3d7479d5f70b 00000100:00080000:0.0:1789081566.188888:0:6584:0:(import.c:65:import_set_state_nolock()) ffff9e1101618000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789081566.188908:0:6584:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1789081566.189424:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081566.189974:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789081566.190782:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11006a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+2:2347:x1875987796074112:12345-192.168.201.17@tcp:9:kworker.0 Request processed in 1911us (4381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081566.190805:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 11 00010000:00010000:1.0:1789081567.004877:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081568.029715:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789081568.092886:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789081568.092926:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821270784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789081568.093048:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081568.093179:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821270784 00000100:00100000:0.0:1789081568.093191:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821270784 00000100:00100000:0.0:1789081568.093287:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789081568.093318:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11006a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821270784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789081568.093369:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789081568.093425:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11006a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821270784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081568.093434:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1789081568.093861:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789081568.093930:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e11010b7480 x1875987821270784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081584 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789081568.093953:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821270784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789081568.608143:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821270912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789081568.608244:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081568.608349:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821270912 00000100:00100000:0.0:1789081568.608359:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821270912 00000100:00100000:0.0:1789081568.608439:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789081568.608449:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821270912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789081568.608493:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789081568.609331:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821270912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 879us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081568.609343:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1789081568.609407:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e11010b5f80 x1875987821270912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081584 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081568.609432:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821270912:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789081568.609547:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789081568.609605:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789081568.609617:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101c31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee551687-7675-4fc6-9be1-2ccb62bdd809:3303:1875987821271040:0@lo:400:kworker.0 00000100:00100000:1.0:1789081568.609670:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081568.609721:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821271040 00000100:00100000:1.0:1789081568.609727:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821271040 00000100:00100000:1.0:1789081568.609768:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789081568.609777:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3303:x1875987821271040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081568.609817:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3303:x1875987821271040:12345-0@lo:400:kworker.0 Request processed in 42us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081568.609824:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789081568.609862:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101c31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee551687-7675-4fc6-9be1-2ccb62bdd809:3303:1875987821271040:0@lo:400:kworker.0 00000100:00100000:1.0:1789081568.609905:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101c31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875987821271168:0@lo:400:kworker.0 00000100:00100000:1.0:1789081568.609936:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081568.609997:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821271168 00000100:00100000:1.0:1789081568.610001:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821271168 00000100:00100000:1.0:1789081568.610031:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789081568.610038:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101c30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875987821271168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081568.610080:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101c30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875987821271168:12345-0@lo:400:kworker.0 Request processed in 43us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081568.610088:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789081568.610118:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101c31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875987821271168:0@lo:400:kworker.0 00000100:00100000:1.0:1789081568.610153:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101c31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875987821271296:0@lo:400:kworker.0 00000100:00100000:1.0:1789081568.610179:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081568.610207:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821271296 00000100:00100000:1.0:1789081568.610211:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821271296 00000100:00100000:1.0:1789081568.610240:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789081568.610246:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101c33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875987821271296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081568.610279:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101c33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875987821271296:12345-0@lo:400:kworker.0 Request processed in 33us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081568.610286:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1789081568.610301:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789081568.610320:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101c31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875987821271296:0@lo:400:kworker.0 00000100:00100000:1.0:1789081568.610349:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101c31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821271424:0@lo:400:kworker.0 00000100:00100000:1.0:1789081568.610377:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081568.610404:0:7788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821271424 00000100:00100000:1.0:1789081568.610408:0:7788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821271424 00000100:00100000:1.0:1789081568.610439:0:7788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789081568.610446:0:7788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101c30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821271424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081568.610481:0:7788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101c30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821271424:12345-0@lo:400:kworker.0 Request processed in 35us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081568.610495:0:7788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1789081568.610551:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e1101c31880 x1875987821271424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789081584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789081568.610562:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101c31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821271424:0@lo:400:kworker.0 00000100:00100000:1.0:1789081568.610592:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789081568.610599:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101c31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875987821271552:0@lo:400:kworker.0 00000100:00100000:1.0:1789081568.610623:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081568.610645:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821271552 00000100:00100000:1.0:1789081568.610649:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821271552 00000100:00100000:1.0:1789081568.610674:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789081568.610680:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101c31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875987821271552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081568.610711:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101c31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875987821271552:12345-0@lo:400:kworker.0 Request processed in 31us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081568.610717:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1789081568.610730:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789081568.610746:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101c31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875987821271552:0@lo:400:kworker.0 00010000:00010000:0.0:1789081569.053310:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081569.249335:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081569.249389:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081569.249566:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796074240 00000100:00100000:1.0:1789081569.249581:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796074240 00000100:00100000:1.0:1789081569.249667:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 198 00000100:00100000:1.0:1789081569.249679:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:2348:x1875987796074240:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:1.0:1789081569.249779:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:2348:x1875987796074240:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 102us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081569.249789:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 198 00000100:00100000:0.0:1789081569.250362:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796074368 00000100:00100000:0.0:1789081569.250371:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796074368 00000100:00100000:0.0:1789081569.250458:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 45 00000100:00100000:0.0:1789081569.250466:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+6:2348:x1875987796074368:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:0.0:1789081569.250517:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+6:2348:x1875987796074368:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 51us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081569.250577:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 45 00000100:00080000:1.0:1789081569.251377:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789081570.076628:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789081570.245040:0:8904:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg117-server.virtnet: executing yml_node 00000001:00100000:2.0:1789081570.254844:0:7493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 41476931-e751-413e-b98c-64d4d0edcd05 00000020:00000080:2.0:1789081570.254857:0:7493:0:(genops.c:906:class_export_put()) final put ffff9e110161c000/41476931-e751-413e-b98c-64d4d0edcd05 00000020:00000080:2.0:1789081570.254937:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e110161c000/41476931-e751-413e-b98c-64d4d0edcd05 for lustre-OST0001 00000020:00000080:2.0:1789081570.255002:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e1101618000 for lustre-OST0001 00010000:00010000:1.0:1789081571.100959:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789081571.273501:0:6607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 41476931-e751-413e-b98c-64d4d0edcd05 00000020:00000080:2.0:1789081571.273516:0:6607:0:(genops.c:906:class_export_put()) final put ffff9e110161f800/41476931-e751-413e-b98c-64d4d0edcd05 00000020:00000080:2.0:1789081571.273580:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e110161f800/41476931-e751-413e-b98c-64d4d0edcd05 for lustre-OST0000 00000020:00000080:2.0:1789081571.273642:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e110161e000 for lustre-OST0000 00000100:00100000:3.0:1789081571.304455:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081571.304513:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081571.304585:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796074496 00000100:00100000:3.0:1789081571.304598:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796074496 00000100:00100000:3.0:1789081571.304661:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 199 00000100:00100000:3.0:1789081571.304673:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:2348:x1875987796074496:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081571.304771:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:2348:x1875987796074496:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 100us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081571.304779:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 199 00000100:00100000:3.0:1789081571.304820:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796074624 00000100:00100000:3.0:1789081571.304824:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796074624 00000100:00100000:3.0:1789081571.304868:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 46 00000100:00100000:3.0:1789081571.304875:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+6:2348:x1875987796074624:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081571.304919:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+6:2348:x1875987796074624:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 44us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081571.304925:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 46 00000100:00080000:3.0:1789081571.305079:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789081572.125370:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081573.148956:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789081573.213014:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789081573.213046:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821271680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789081573.213149:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081573.213400:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821271680 00000100:00100000:0.0:1789081573.213412:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821271680 00000100:00100000:0.0:1789081573.213500:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789081573.213511:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff5de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821271680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789081573.213610:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789081573.213674:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff5de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821271680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 164us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081573.213683:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1789081573.213787:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e11010b5f80 x1875987821271680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081589 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081573.213813:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821271680:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789081573.214033:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789081573.725360:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821271808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789081573.725479:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081573.726049:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821271808 00000100:00100000:0.0:1789081573.726061:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821271808 00000100:00100000:0.0:1789081573.726156:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789081573.726169:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821271808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789081573.726218:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789081573.726297:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821271808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081573.726305:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1789081573.726627:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789081573.726937:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e11010b5f80 x1875987821271808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081589 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081573.726965:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821271808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789081573.727711:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff5df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875987821272192:0@lo:400:kworker.0 00000100:00100000:2.0:1789081573.727799:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081573.727834:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789081573.727840:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff5dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875987821272320:0@lo:400:kworker.0 00000100:00100000:2.0:1789081573.727875:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081573.727910:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821272192 00000100:00100000:2.0:1789081573.727917:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821272192 00000100:00100000:2.0:1789081573.727975:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821272320 00000100:00100000:2.0:1789081573.727978:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821272320 00000100:00100000:2.0:1789081573.728017:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789081573.728026:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff5dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875987821272192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789081573.728078:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff5dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875987821272192:12345-0@lo:400:kworker.0 Request processed in 54us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081573.728086:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789081573.728757:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff5df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875987821272064:0@lo:400:kworker.0 00000100:00100000:3.0:1789081573.728801:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081573.728821:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789081573.728828:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff5dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821271936:0@lo:400:kworker.0 00000100:00100000:3.0:1789081573.728891:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081573.729023:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821272064 00000100:00100000:1.0:1789081573.729029:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821272064 00000100:00100000:1.0:1789081573.729061:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789081573.729069:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff5dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875987821272320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081573.729126:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff5dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875987821272320:12345-0@lo:400:kworker.0 Request processed in 58us (1250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081573.729134:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789081573.729149:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789081573.729155:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875987821272064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081573.729182:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875987821272064:12345-0@lo:400:kworker.0 Request processed in 28us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081573.729188:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1789081573.729212:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789081573.733632:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff5df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875987821272064:0@lo:400:kworker.0 00000100:00100000:3.0:1789081573.733696:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821271936 00000100:00100000:3.0:1789081573.733704:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821271936 00000100:00100000:1.0:1789081573.733856:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff5dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875987821272320:0@lo:400:kworker.0 00000100:00100000:1.0:1789081573.733884:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff5df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875987821272192:0@lo:400:kworker.0 00000100:00100000:3.0:1789081573.734362:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789081573.734375:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3304:x1875987821271936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081573.734489:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3304:x1875987821271936:12345-0@lo:400:kworker.0 Request processed in 117us (5629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081573.734497:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789081573.734703:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff5dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821271936:0@lo:400:kworker.0 00010000:00010000:2.0:1789081574.172753:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789081575.046577:0:9097:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.55.25 00010000:00010000:3.0:1789081575.197744:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081576.221725:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789081576.407303:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081576.407376:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081576.407484:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796074880 00000100:00100000:2.0:1789081576.407494:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796074880 00000100:00100000:2.0:1789081576.407596:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 50 00000100:00100000:2.0:1789081576.407608:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+6:2348:x1875987796074880:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:2.0:1789081576.407696:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+6:2348:x1875987796074880:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 91us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081576.407703:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 50 00000100:00080000:1.0:1789081576.407875:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789081576.407928:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796074752 00000100:00100000:3.0:1789081576.407933:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796074752 00000100:00100000:3.0:1789081576.407980:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 201 00000100:00100000:3.0:1789081576.407988:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:2348:x1875987796074752:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081576.408017:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:2348:x1875987796074752:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 30us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081576.408024:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 201 00010000:00010000:3.0:1789081577.245099:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789081577.927408:0:9195:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.55.25 00010000:00010000:1.0:1789081578.275154:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789081578.332888:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821272448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789081578.332986:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081578.333129:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821272448 00000100:00100000:2.0:1789081578.333139:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821272448 00000100:00100000:2.0:1789081578.333225:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789081578.333237:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821272448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789081578.333294:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789081578.333744:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821272448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 509us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081578.333751:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1789081578.333788:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789081578.333875:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e11010b5f80 x1875987821272448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081594 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789081578.333895:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821272448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789081578.844835:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789081578.844870:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821272576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789081578.844983:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081578.845248:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821272576 00000100:00100000:0.0:1789081578.845348:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821272576 00000100:00100000:0.0:1789081578.845435:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789081578.845446:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821272576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789081578.845495:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789081578.845579:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821272576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081578.845588:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1789081578.845614:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789081578.845933:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e11010b6a00 x1875987821272576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081594 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789081578.845957:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821272576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789081578.849116:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875987821272832:0@lo:400:kworker.0 00000100:00100000:3.0:1789081578.849161:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff703100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875987821273088:0@lo:400:kworker.0 00000100:00100000:3.0:1789081578.849234:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081578.849284:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789081578.849290:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875987821272960:0@lo:400:kworker.0 00000100:00100000:0.0:1789081578.849301:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081578.849330:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081578.849338:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789081578.849343:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821272704:0@lo:400:kworker.0 00000100:00100000:3.0:1789081578.849362:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821273088 00000100:00100000:3.0:1789081578.849370:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821273088 00000100:00100000:0.0:1789081578.849374:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081578.849437:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821272832 00000100:00100000:3.0:1789081578.849441:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821272832 00000100:00100000:3.0:1789081578.849473:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821272960 00000100:00100000:3.0:1789081578.849477:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821272960 00000100:00100000:1.0:1789081578.849481:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789081578.849492:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789081578.849494:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff703800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875987821273088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081578.849497:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875987821272832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081578.849626:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1789081578.849636:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1789081578.851736:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821272704 00000100:00100000:0.0:1789081578.851755:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821272704 00000100:00100000:0.0:1789081578.851845:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789081578.851858:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3306:x1875987821272704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081578.854863:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875987821272832:12345-0@lo:400:kworker.0 Request processed in 5349us (5545us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081578.854884:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789081578.854941:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789081578.854957:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff701880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875987821272960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081578.855032:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff701880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875987821272960:12345-0@lo:400:kworker.0 Request processed in 83us (5701us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081578.855038:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789081578.855620:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff703800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875987821273088:12345-0@lo:400:kworker.0 Request processed in 6126us (6383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081578.855629:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789081578.855817:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3306:x1875987821272704:12345-0@lo:400:kworker.0 Request processed in 3961us (6439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081578.855828:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:0.0:1789081578.856759:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789081578.856832:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821272704:0@lo:400:kworker.0 00000100:00100000:0.0:1789081578.856858:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875987821272832:0@lo:400:kworker.0 00000100:00100000:3.0:1789081578.857282:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875987821272960:0@lo:400:kworker.0 00000100:00100000:3.0:1789081578.857299:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff703100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875987821273088:0@lo:400:kworker.0 00010000:00010000:3.0:1789081579.296891:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081580.316838:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789081581.038215:0:9295:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.55.25 00010000:00010000:1.0:1789081581.346173:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789081581.532165:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081581.532237:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081581.532375:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796075008 00000100:00100000:3.0:1789081581.532388:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796075008 00000100:00100000:3.0:1789081581.532463:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 203 00000100:00100000:3.0:1789081581.532492:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:2348:x1875987796075008:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081581.532630:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:2348:x1875987796075008:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 140us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081581.532639:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 203 00000100:00100000:2.0:1789081581.533047:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796075136 00000100:00100000:2.0:1789081581.533054:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796075136 00000100:00100000:2.0:1789081581.533124:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 54 00000100:00100000:2.0:1789081581.533133:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+6:2348:x1875987796075136:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:2.0:1789081581.533192:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+6:2348:x1875987796075136:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 60us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081581.533200:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 54 00000100:00080000:0.0:1789081581.533315:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789081582.367287:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789081582.740548:0:9344:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Sep 10 19:06:21 EDT 2026 00010000:00010000:1.0:1789081583.388806:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789081583.454517:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789081583.454568:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821273216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789081583.454675:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081583.454782:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821273216 00000100:00100000:1.0:1789081583.454791:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821273216 00000100:00100000:1.0:1789081583.454865:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789081583.454876:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff780000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821273216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789081583.456044:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789081583.456129:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff780000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821273216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1255us (1454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081583.456139:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1789081583.456176:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789081583.456209:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10ff781c00 x1875987821273216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081599 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789081583.456232:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821273216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789081583.964983:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875987821273472:0@lo:400:kworker.0 00000100:00100000:1.0:1789081583.965055:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081583.965132:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821273472 00000100:00100000:1.0:1789081583.965139:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821273472 00000100:00100000:1.0:1789081583.965192:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789081583.965202:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875987821273472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081583.965252:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875987821273472:12345-0@lo:400:kworker.0 Request processed in 52us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081583.965259:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789081583.965316:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875987821273472:0@lo:400:kworker.0 00000100:00100000:1.0:1789081583.965355:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875987821273600:0@lo:400:kworker.0 00000100:00100000:1.0:1789081583.965379:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081583.965673:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789081583.965693:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821273984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789081583.965719:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081583.965748:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821273984 00000100:00100000:1.0:1789081583.965751:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821273984 00000100:00100000:1.0:1789081583.965797:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789081583.965803:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821273984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789081583.965829:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789081583.965864:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821273984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081583.965870:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1789081583.965884:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789081583.965907:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10ff783100 x1875987821273984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081599 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789081583.965921:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821273984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789081583.966081:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821273344:0@lo:400:kworker.0 00000100:00100000:2.0:1789081583.966118:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081583.966151:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821273856:0@lo:400:kworker.0 00000100:00100000:2.0:1789081583.966176:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081583.966206:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789081583.966213:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875987821273728:0@lo:400:kworker.0 00000100:00100000:2.0:1789081583.966234:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081583.966262:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821273856 00000100:00100000:2.0:1789081583.966266:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821273856 00000100:00100000:2.0:1789081583.966292:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789081583.966298:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821273856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789081583.966334:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821273856:12345-0@lo:400:kworker.0 Request processed in 36us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081583.966341:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789081583.966358:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821273600 00000100:00100000:2.0:1789081583.966363:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821273600 00000100:00100000:2.0:1789081583.966385:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821273728 00000100:00100000:2.0:1789081583.966388:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821273728 00000100:00100000:2.0:1789081583.966403:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789081583.966409:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875987821273600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789081583.966438:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875987821273600:12345-0@lo:400:kworker.0 Request processed in 29us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081583.966443:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789081583.966455:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789081583.966461:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875987821273728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789081583.966486:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875987821273728:12345-0@lo:400:kworker.0 Request processed in 26us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081583.966492:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789081583.966544:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875987821273728:0@lo:400:kworker.0 00010000:00080000:2.0:1789081583.966556:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10ff781180 x1875987821273856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789081599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789081583.966578:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821273856:0@lo:400:kworker.0 00000100:00100000:1.0:1789081583.967420:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821273344 00000100:00100000:1.0:1789081583.967431:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821273344 00000100:00100000:1.0:1789081583.967551:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1789081583.967561:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3306:x1875987821273344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081583.967634:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3306:x1875987821273344:12345-0@lo:400:kworker.0 Request processed in 75us (1515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081583.967641:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1789081583.967731:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821273344:0@lo:400:kworker.0 00000100:00080000:0.0:1789081583.974072:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789081583.975857:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875987821273600:0@lo:400:kworker.0 00010000:00010000:0.0:1789081584.415520:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081585.456552:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081586.462206:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789081586.658326:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081586.658402:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081586.658454:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796075264 00000100:00100000:2.0:1789081586.658470:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796075264 00000100:00100000:2.0:1789081586.658581:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 205 00000100:00100000:2.0:1789081586.658595:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:2351:x1875987796075264:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:2.0:1789081586.658715:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:2351:x1875987796075264:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 123us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081586.658724:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 205 00000100:00100000:3.0:1789081586.659623:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796075392 00000100:00100000:3.0:1789081586.659644:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796075392 00000100:00100000:3.0:1789081586.659718:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 58 00000100:00100000:3.0:1789081586.659727:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff5dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+6:2351:x1875987796075392:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081586.659794:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff5dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+6:2351:x1875987796075392:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 67us (1482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081586.659802:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 58 00000100:00080000:0.0:1789081586.660138:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789081587.485016:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081588.510689:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789081588.580133:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789081588.580164:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821274112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789081588.580259:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081588.580344:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821274112 00000100:00100000:2.0:1789081588.580353:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821274112 00000100:00100000:2.0:1789081588.580450:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789081588.580461:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff5df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821274112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789081588.580508:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789081588.580589:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff5df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821274112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081588.580608:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1789081588.580662:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10ff5dd500 x1875987821274112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081604 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789081588.580702:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821274112:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789081588.580964:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789081589.086443:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789081589.089735:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821274368:0@lo:400:kworker.0 00000100:00100000:0.0:1789081589.089847:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081589.089934:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789081589.089944:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821274240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789081589.089977:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081589.090017:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821274368 00000100:00100000:0.0:1789081589.090027:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821274368 00000100:00100000:0.0:1789081589.090082:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789081589.090092:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3306:x1875987821274368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081589.090153:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3306:x1875987821274368:12345-0@lo:400:kworker.0 Request processed in 62us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081589.090161:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789081589.090198:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821274240 00000100:00100000:0.0:1789081589.090202:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821274240 00000100:00100000:0.0:1789081589.090239:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789081589.090245:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821274240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789081589.090280:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789081589.090316:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821274240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081589.090322:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1789081589.090343:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789081589.090400:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10ff783100 x1875987821274240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081605 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081589.090424:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821274240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789081589.090435:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821274368:0@lo:400:kworker.0 00000100:00100000:0.0:1789081589.091275:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff5ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875987821274624:0@lo:400:kworker.0 00000100:00100000:0.0:1789081589.091330:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081589.091371:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875987821274496:0@lo:400:kworker.0 00000100:00100000:0.0:1789081589.091403:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081589.091433:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821274624 00000100:00100000:0.0:1789081589.091439:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821274624 00000100:00100000:1.0:1789081589.091615:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821274496 00000100:00100000:1.0:1789081589.091620:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821274496 00000100:00100000:1.0:1789081589.091674:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789081589.091682:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875987821274496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081589.091735:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875987821274496:12345-0@lo:400:kworker.0 Request processed in 53us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081589.091742:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789081589.091977:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789081589.091986:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875987821274624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081589.092020:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875987821274624:12345-0@lo:400:kworker.0 Request processed in 36us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081589.092027:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1789081589.092047:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789081589.092074:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875987821274496:0@lo:400:kworker.0 00000100:00100000:0.0:1789081589.092099:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff5ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875987821274624:0@lo:400:kworker.0 00000100:00100000:2.0:1789081589.092734:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789081589.092748:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff5dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875987821274752:0@lo:400:kworker.0 00000100:00100000:2.0:1789081589.093037:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081589.093275:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821274752 00000100:00100000:0.0:1789081589.093284:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821274752 00000100:00100000:0.0:1789081589.093354:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789081589.093363:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff5dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875987821274752:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789081589.093640:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789081589.094621:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff5dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875987821274752:12345-0@lo:400:kworker.0 Request processed in 1252us (1578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081589.094660:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789081589.094964:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff5dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875987821274752:0@lo:400:kworker.0 00010000:00010000:1.0:1789081589.542606:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081590.561491:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081591.580934:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081591.768013:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081591.768073:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081591.768274:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796075648 00000100:00100000:1.0:1789081591.768291:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796075648 00000100:00100000:2.0:1789081591.768323:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796075520 00000100:00100000:2.0:1789081591.768328:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796075520 00000100:00100000:1.0:1789081591.768382:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 62 00000100:00080000:3.0:1789081591.768394:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789081591.768396:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff703100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+6:2349:x1875987796075648:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:2.0:1789081591.768428:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 207 00000100:00100000:2.0:1789081591.768437:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:2349:x1875987796075520:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:1.0:1789081591.768578:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff703100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+6:2349:x1875987796075648:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 184us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081591.768587:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 62 00000100:00100000:2.0:1789081591.768811:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:2349:x1875987796075520:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 363us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081591.768819:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 207 00010000:00010000:2.0:1789081592.604661:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081593.640232:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789081593.695224:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789081593.695249:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821274880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789081593.695331:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081593.695411:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821274880 00000100:00100000:0.0:1789081593.695418:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821274880 00000100:00100000:0.0:1789081593.695476:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789081593.695485:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821274880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789081593.695563:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789081593.695610:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821274880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081593.695617:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1789081593.695638:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789081593.695681:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e11010b5500 x1875987821274880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081609 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081593.695701:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821274880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789081594.205055:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821275008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789081594.205139:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081594.205219:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821275008 00000100:00100000:0.0:1789081594.205226:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821275008 00000100:00100000:0.0:1789081594.205279:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789081594.205287:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821275008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789081594.205333:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789081594.205378:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821275008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081594.205400:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1789081594.205421:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789081594.205451:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10f5c79f80 x1875987821275008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081610 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081594.205471:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821275008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789081594.212284:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821275136:0@lo:400:kworker.0 00000100:00100000:0.0:1789081594.212376:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081594.212421:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875987821275648:0@lo:400:kworker.0 00000100:00100000:0.0:1789081594.212449:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081594.212474:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789081594.212481:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821275520:0@lo:400:kworker.0 00000100:00100000:0.0:1789081594.212518:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081594.212577:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875987821275264:0@lo:400:kworker.0 00000100:00100000:0.0:1789081594.212603:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081594.212620:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789081594.212625:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875987821275392:0@lo:400:kworker.0 00000100:00100000:0.0:1789081594.212680:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081594.212712:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821275136 00000100:00100000:0.0:1789081594.212720:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821275136 00000100:00100000:0.0:1789081594.212764:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789081594.212773:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3304:x1875987821275136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081594.212825:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3304:x1875987821275136:12345-0@lo:400:kworker.0 Request processed in 52us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081594.212833:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789081594.212874:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821275648 00000100:00100000:0.0:1789081594.212878:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821275648 00000100:00100000:0.0:1789081594.212910:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821275264 00000100:00100000:0.0:1789081594.212913:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821275264 00000100:00100000:0.0:1789081594.212927:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821275392 00000100:00100000:0.0:1789081594.212930:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821275392 00000100:00100000:0.0:1789081594.212944:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789081594.212950:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875987821275648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081594.212985:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875987821275648:12345-0@lo:400:kworker.0 Request processed in 35us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081594.212991:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789081594.213004:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789081594.213009:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875987821275264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081594.213042:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875987821275264:12345-0@lo:400:kworker.0 Request processed in 33us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081594.213049:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789081594.213060:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789081594.213065:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d102b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875987821275392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081594.213094:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d102b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875987821275392:12345-0@lo:400:kworker.0 Request processed in 28us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081594.213100:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1789081594.213115:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789081594.213145:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875987821275392:0@lo:400:kworker.0 00000100:00100000:0.0:1789081594.213156:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875987821275264:0@lo:400:kworker.0 00000100:00100000:0.0:1789081594.213183:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821275136:0@lo:400:kworker.0 00000100:00100000:0.0:1789081594.213191:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875987821275648:0@lo:400:kworker.0 00000100:00100000:2.0:1789081594.216260:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821275520 00000100:00100000:2.0:1789081594.216280:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821275520 00000100:00100000:2.0:1789081594.216362:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789081594.216374:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821275520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789081594.216484:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821275520:12345-0@lo:400:kworker.0 Request processed in 112us (3965us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081594.216492:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1789081594.216575:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10d1b33800 x1875987821275520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789081610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789081594.216591:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821275520:0@lo:400:kworker.0 00010000:00010000:1.0:1789081594.668916:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081595.678903:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081596.700786:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081596.889041:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081596.889110:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081596.889306:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796075904 00000100:00100000:0.0:1789081596.889320:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796075904 00000100:00100000:1.0:1789081596.889331:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796075776 00000100:00100000:1.0:1789081596.889338:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796075776 00000100:00100000:1.0:1789081596.889409:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 209 00000100:00100000:0.0:1789081596.889418:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 66 00000100:00100000:1.0:1789081596.889421:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:2349:x1875987796075776:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:0.0:1789081596.889433:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff701180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+6:2349:x1875987796075904:12345-192.168.201.17@tcp:400:kworker.0 00000100:00080000:2.0:1789081596.889561:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789081596.889669:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:2349:x1875987796075776:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 250us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081596.889678:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 209 00000100:00100000:0.0:1789081596.893712:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff701180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+6:2349:x1875987796075904:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 3802us (4202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081596.893742:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 66 00010000:00010000:1.0:1789081597.726778:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081598.748978:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789081598.816920:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff5ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821275776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789081598.817017:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081598.817491:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821275776 00000100:00100000:2.0:1789081598.817514:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821275776 00000100:00100000:2.0:1789081598.817820:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789081598.817836:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d102a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821275776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789081598.817887:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789081598.817954:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d102a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821275776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081598.817963:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1789081598.818016:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10ff5ded80 x1875987821275776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081614 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789081598.818039:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff5ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821275776:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789081598.818734:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1789081599.216317:0:9973:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 19:06:37 (1789081597) === 00000100:00100000:0.0:1789081599.324977:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1029c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821275904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789081599.325078:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081599.325162:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821275904 00000100:00100000:0.0:1789081599.325171:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821275904 00000100:00100000:0.0:1789081599.325240:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789081599.325249:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1028000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821275904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789081599.325289:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789081599.325334:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1028000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821275904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081599.325342:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1789081599.325366:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789081599.325398:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10d1029c00 x1875987821275904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081615 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081599.325429:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1029c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821275904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789081599.325563:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1029c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee551687-7675-4fc6-9be1-2ccb62bdd809:3303:1875987821276032:0@lo:400:kworker.0 00000100:00100000:0.0:1789081599.325613:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081599.325653:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d102a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875987821276544:0@lo:400:kworker.0 00000100:00100000:0.0:1789081599.325680:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081599.325702:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789081599.325708:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d102aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875987821276160:0@lo:400:kworker.0 00000100:00100000:0.0:1789081599.325730:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081599.325758:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821276544 00000100:00100000:0.0:1789081599.325762:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821276544 00000100:00100000:0.0:1789081599.325794:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821276160 00000100:00100000:0.0:1789081599.325796:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821276160 00000100:00100000:0.0:1789081599.325816:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789081599.325822:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1029180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875987821276544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081599.325860:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1029180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875987821276544:12345-0@lo:400:kworker.0 Request processed in 38us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081599.325867:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789081599.325881:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789081599.325886:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d102b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875987821276160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081599.325914:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d102b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875987821276160:12345-0@lo:400:kworker.0 Request processed in 27us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081599.325920:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789081599.325941:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d102ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875987821276288:0@lo:400:kworker.0 00000100:00100000:0.0:1789081599.325967:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081599.325986:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789081599.325992:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1029f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821276416:0@lo:400:kworker.0 00000100:00100000:0.0:1789081599.326015:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081599.326039:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821276288 00000100:00100000:0.0:1789081599.326050:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821276288 00000100:00100000:0.0:1789081599.326075:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789081599.326082:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d102b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875987821276288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081599.326115:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d102b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875987821276288:12345-0@lo:400:kworker.0 Request processed in 34us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081599.326122:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789081599.326140:0:7788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821276416 00000100:00100000:0.0:1789081599.326143:0:7788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821276416 00000100:00100000:0.0:1789081599.326166:0:7788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789081599.326172:0:7788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1029880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821276416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081599.326201:0:7788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1029880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821276416:12345-0@lo:400:kworker.0 Request processed in 29us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081599.326207:0:7788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1789081599.326224:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789081599.326243:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10d1029f80 x1875987821276416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789081615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081599.326253:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1029f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821276416:0@lo:400:kworker.0 00000100:00100000:0.0:1789081599.326263:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d102ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875987821276288:0@lo:400:kworker.0 00000100:00100000:0.0:1789081599.326291:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d102aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875987821276160:0@lo:400:kworker.0 00000100:00100000:0.0:1789081599.326300:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d102a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875987821276544:0@lo:400:kworker.0 00000100:00100000:1.0:1789081599.326414:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821276032 00000100:00100000:1.0:1789081599.326420:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821276032 00000100:00100000:1.0:1789081599.326453:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1789081599.326460:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3303:x1875987821276032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081599.326745:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3303:x1875987821276032:12345-0@lo:400:kworker.0 Request processed in 285us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081599.326752:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1789081599.326794:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1029c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee551687-7675-4fc6-9be1-2ccb62bdd809:3303:1875987821276032:0@lo:400:kworker.0 00010000:00010000:1.0:1789081599.772931:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081599.853591:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081599.853984:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796076032 00000100:00100000:1.0:1789081599.853995:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796076032 00000100:00100000:1.0:1789081599.854058:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 211 00000100:00100000:1.0:1789081599.854069:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:8118:x1875987796076032:12345-192.168.201.17@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789081599.854086:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081599.854106:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10e13ae400/0xb7cb3d7479d5f7cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a7a1 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081599.854138:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10e13ae400/0xb7cb3d7479d5f7cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a7a1 expref: 11 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081599.854151:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10e13ae400/0xb7cb3d7479d5f7cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a7a1 expref: 11 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081599.854161:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13ae400, rc 0) 00000100:00100000:1.0:1789081599.854230:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+11:8118:x1875987796076032:12345-192.168.201.17@tcp:101:mount.lustre.0 Request processed in 153us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081599.854238:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 211 00000100:00100000:3.0:1789081599.867713:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081599.868199:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796076160 00000100:00100000:1.0:1789081599.868209:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796076160 00000100:00100000:1.0:1789081599.868336:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 212 00000100:00100000:1.0:1789081599.868347:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+11:8118:x1875987796076160:12345-192.168.201.17@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789081599.868725:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+11:8118:x1875987796076160:12345-192.168.201.17@tcp:501:mount.lustre.0 Request processed in 378us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081599.868733:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 212 00000100:00100000:3.0:1789081599.876289:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081599.879021:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796076288 00000100:00100000:2.0:1789081599.879041:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796076288 00000100:00100000:2.0:1789081599.879126:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 213 00000100:00100000:2.0:1789081599.879138:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+11:8118:x1875987796076288:12345-192.168.201.17@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789081599.879603:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+11:8118:x1875987796076288:12345-192.168.201.17@tcp:503:mount.lustre.0 Request processed in 467us (3325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081599.879612:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 213 00000100:00100000:3.0:1789081599.889651:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081599.897498:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796076416 00000100:00100000:1.0:1789081599.897518:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796076416 00000100:00100000:1.0:1789081599.897615:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 214 00000100:00100000:1.0:1789081599.897626:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+11:8122:x1875987796076416:12345-192.168.201.17@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789081599.898003:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+11:8122:x1875987796076416:12345-192.168.201.17@tcp:502:llog_process_th.0 Request processed in 378us (8363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081599.898023:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 214 00000100:00100000:3.0:1789081599.948628:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081599.948789:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796076544 00000100:00100000:0.0:1789081599.948799:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796076544 00000100:00100000:0.0:1789081599.948861:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 215 00000100:00100000:0.0:1789081599.948871:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+11:8122:x1875987796076544:12345-192.168.201.17@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789081599.950615:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+11:8122:x1875987796076544:12345-192.168.201.17@tcp:502:llog_process_th.0 Request processed in 1734us (1990us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081599.950639:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 215 00000100:00100000:3.0:1789081599.956063:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081599.956177:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796076672 00000100:00100000:2.0:1789081599.956188:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796076672 00000100:00100000:2.0:1789081599.956247:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 216 00000100:00100000:2.0:1789081599.956258:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+11:8118:x1875987796076672:12345-192.168.201.17@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789081599.956274:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081599.956293:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10c29e1600/0xb7cb3d7479d5f7d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a7cb expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081599.956341:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10c29e1600/0xb7cb3d7479d5f7d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a7cb expref: 12 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081599.956354:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10c29e1600/0xb7cb3d7479d5f7d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a7cb expref: 12 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081599.956363:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10c29e1600, rc 0) 00000100:00100000:2.0:1789081599.956429:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+12:8118:x1875987796076672:12345-192.168.201.17@tcp:101:mount.lustre.0 Request processed in 173us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081599.956438:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 216 00000100:00100000:3.0:1789081599.961454:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081599.963296:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796076800 00000100:00100000:0.0:1789081599.963315:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796076800 00000100:00100000:0.0:1789081599.963390:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 217 00000100:00100000:0.0:1789081599.963410:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+12:8118:x1875987796076800:12345-192.168.201.17@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789081599.963440:0:5784:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789081599.963470:0:5784:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789081599.963475:0:5784:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789081599.963478:0:5784:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789081599.963481:0:5784:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1789081599.966915:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+12:8118:x1875987796076800:12345-192.168.201.17@tcp:256:mount.lustre.0 Request processed in 3492us (5459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081599.966929:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 217 00000100:00100000:0.0:1789081599.976729:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081599.976852:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796076928 00000100:00100000:1.0:1789081599.976863:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796076928 00000100:00100000:1.0:1789081599.976918:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 218 00000100:00100000:1.0:1789081599.976927:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+12:8118:x1875987796076928:12345-192.168.201.17@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789081599.976949:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081599.976967:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10e13afa00/0xb7cb3d7479d5f7dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a7d2 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081599.976997:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10e13afa00/0xb7cb3d7479d5f7dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a7d2 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081599.977008:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10e13afa00/0xb7cb3d7479d5f7dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a7d2 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081599.977018:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13afa00, rc 0) 00000100:00100000:1.0:1789081599.977072:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:8118:x1875987796076928:12345-192.168.201.17@tcp:101:mount.lustre.0 Request processed in 147us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081599.977093:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 218 00000100:00100000:2.0:1789081599.981649:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081599.981849:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796077056 00000100:00100000:3.0:1789081599.981860:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796077056 00000100:00100000:3.0:1789081599.981966:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 219 00000100:00100000:3.0:1789081599.981977:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:8118:x1875987796077056:12345-192.168.201.17@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789081599.982277:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:8118:x1875987796077056:12345-192.168.201.17@tcp:501:mount.lustre.0 Request processed in 301us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081599.982285:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 219 00000100:00100000:0.0:1789081599.995611:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081599.995804:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796077184 00000100:00100000:2.0:1789081599.995814:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796077184 00000100:00100000:2.0:1789081599.995869:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 220 00000100:00100000:2.0:1789081599.995878:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:8118:x1875987796077184:12345-192.168.201.17@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789081599.996118:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:8118:x1875987796077184:12345-192.168.201.17@tcp:503:mount.lustre.0 Request processed in 239us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081599.996126:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 220 00000100:00100000:0.0:1789081600.007841:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081600.007931:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796077312 00000100:00100000:3.0:1789081600.007944:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796077312 00000100:00100000:3.0:1789081600.008024:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 221 00000100:00100000:3.0:1789081600.008035:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:8126:x1875987796077312:12345-192.168.201.17@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789081600.008597:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:8126:x1875987796077312:12345-192.168.201.17@tcp:502:llog_process_th.0 Request processed in 562us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081600.008606:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 221 00000100:00100000:3.0:1789081600.019309:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081600.023868:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796077440 00000100:00100000:1.0:1789081600.023884:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796077440 00000100:00100000:1.0:1789081600.023952:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 222 00000100:00100000:1.0:1789081600.023961:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:8126:x1875987796077440:12345-192.168.201.17@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789081600.024223:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:8126:x1875987796077440:12345-192.168.201.17@tcp:502:llog_process_th.0 Request processed in 263us (4925us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081600.024231:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 222 00000100:00100000:0.0:1789081600.036966:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081600.037025:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081600.037113:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796077568 00000100:00100000:2.0:1789081600.037123:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796077568 00000100:00100000:2.0:1789081600.037169:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796077952 00000100:00100000:2.0:1789081600.037172:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796077952 00000100:00100000:2.0:1789081600.037237:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 70 00000100:00100000:2.0:1789081600.037249:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d102aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+6:2348:x1875987796077952:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:2.0:1789081600.037332:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d102aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+6:2348:x1875987796077952:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 85us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081600.037356:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 70 00000100:00100000:2.0:1789081600.037374:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 10 00000100:00100000:2.0:1789081600.037378:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d102a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2347:x1875987796077568:12345-192.168.201.17@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789081600.037411:0:5790:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 03f7db20-3934-4266-b84f-346a4ea22636@192.168.201.17@tcp t0 exp 0000000000000000 cur 266 last 0 00000020:00000080:2.0:1789081600.037448:0:5790:0:(genops.c:1406:class_connect()) connect: client 03f7db20-3934-4266-b84f-346a4ea22636, cookie 0xb7cb3d7479d5f7e4 00000004:00100000:2.0:1789081600.037477:0:5790:0:(mdt_handler.c:7402:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789081600.037775:0:5790:0:(import.c:65:import_set_state_nolock()) ffff9e10f98e4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789081600.037809:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d102a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03f7db20-3934-4266-b84f-346a4ea22636+6:2347:x1875987796077568:12345-192.168.201.17@tcp:38:mount.lustre.0 Request processed in 428us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081600.037816:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 10 00000100:00080000:3.0:1789081600.038412:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789081600.057598:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081600.057693:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081600.057966:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796077696 00000100:00100000:3.0:1789081600.057992:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796077696 00000100:00100000:3.0:1789081600.058068:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796077824 00000100:00100000:3.0:1789081600.058072:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796077824 00000100:00100000:3.0:1789081600.058092:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 11 00000100:00100000:3.0:1789081600.058102:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d102ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03f7db20-3934-4266-b84f-346a4ea22636+7:0:x1875987796077696:12345-192.168.201.17@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789081600.058152:0:7252:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789081600.058275:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d102ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03f7db20-3934-4266-b84f-346a4ea22636+7:0:x1875987796077696:12345-192.168.201.17@tcp:41:mount.lustre.0 Request processed in 173us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081600.058283:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 11 00000100:00100000:3.0:1789081600.058303:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 12 00000100:00100000:3.0:1789081600.058311:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1029f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03f7db20-3934-4266-b84f-346a4ea22636+6:8118:x1875987796077824:12345-192.168.201.17@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789081600.058323:0:7252:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789081600.058346:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1029f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03f7db20-3934-4266-b84f-346a4ea22636+6:8118:x1875987796077824:12345-192.168.201.17@tcp:41:mount.lustre.0 Request processed in 36us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081600.058352:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 12 00000100:00080000:0.0:1789081600.058729:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789081600.063431:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081600.063572:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796078080 00000100:00100000:0.0:1789081600.063582:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796078080 00000100:00100000:0.0:1789081600.063643:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 13 00000100:00100000:0.0:1789081600.063653:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff5ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03f7db20-3934-4266-b84f-346a4ea22636+6:8118:x1875987796078080:12345-192.168.201.17@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789081600.063740:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff5ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03f7db20-3934-4266-b84f-346a4ea22636+6:8118:x1875987796078080:12345-192.168.201.17@tcp:40:mount.lustre.0 Request processed in 88us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081600.063748:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 13 00000100:00100000:3.0:1789081600.068596:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081600.068865:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796078208 00000100:00100000:2.0:1789081600.068881:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796078208 00000100:00100000:2.0:1789081600.068945:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 12 00000100:00100000:2.0:1789081600.068954:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff700380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2347:x1875987796078208:12345-192.168.201.17@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789081600.069166:0:6582:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 03f7db20-3934-4266-b84f-346a4ea22636@192.168.201.17@tcp t0 exp 0000000000000000 cur 266 last 0 00000020:00000080:2.0:1789081600.069200:0:6582:0:(genops.c:1406:class_connect()) connect: client 03f7db20-3934-4266-b84f-346a4ea22636, cookie 0xb7cb3d7479d5f7eb 00002000:00100000:2.0:1789081600.069211:0:6582:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 03f7db20-3934-4266-b84f-346a4ea22636/ffff9e10f98e6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113719 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789081600.069234:0:6582:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789081600.069494:0:6582:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789081600.069579:0:6582:0:(import.c:65:import_set_state_nolock()) ffff9e10f98e4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789081600.069612:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081600.069657:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff700380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03f7db20-3934-4266-b84f-346a4ea22636+6:2347:x1875987796078208:12345-192.168.201.17@tcp:8:mount.lustre.0 Request processed in 701us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081600.069665:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 12 00000100:00100000:0.0:1789081600.069702:0:7788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796078336 00000100:00100000:0.0:1789081600.069725:0:7788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796078336 00000100:00100000:0.0:1789081600.069775:0:7788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 13 00000100:00100000:0.0:1789081600.069783:0:7788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff700e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2347:x1875987796078336:12345-192.168.201.17@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789081600.069817:0:7788:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 03f7db20-3934-4266-b84f-346a4ea22636@192.168.201.17@tcp t0 exp 0000000000000000 cur 266 last 0 00000020:00000080:0.0:1789081600.069852:0:7788:0:(genops.c:1406:class_connect()) connect: client 03f7db20-3934-4266-b84f-346a4ea22636, cookie 0xb7cb3d7479d5f7f2 00002000:00100000:0.0:1789081600.069863:0:7788:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 03f7db20-3934-4266-b84f-346a4ea22636/ffff9e10ff75f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113719 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789081600.069874:0:7788:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789081600.070151:0:7788:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789081600.070181:0:7788:0:(import.c:65:import_set_state_nolock()) ffff9e10ff75e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789081600.077551:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081600.077642:0:7788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff700e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03f7db20-3934-4266-b84f-346a4ea22636+6:2347:x1875987796078336:12345-192.168.201.17@tcp:8:mount.lustre.0 Request processed in 7854us (8030us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081600.077660:0:7788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 13 00000100:00100000:1.0:1789081600.082735:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796078464 00000100:00100000:1.0:1789081600.082753:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796078464 00000100:00100000:1.0:1789081600.082840:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 1 00000100:00100000:1.0:1789081600.082852:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff703b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03f7db20-3934-4266-b84f-346a4ea22636+6:8118:x1875987796078464:12345-192.168.201.17@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789081600.083702:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1789081600.083909:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff703b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03f7db20-3934-4266-b84f-346a4ea22636+6:8118:x1875987796078464:12345-192.168.201.17@tcp:33:mount.lustre.0 Request processed in 1056us (6390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081600.083920:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 1 00010000:00010000:1.0:1789081600.797160:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789081600.917622:0:5811:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 03f7db20-3934-4266-b84f-346a4ea22636 00000001:00100000:2.0:1789081600.918824:0:7493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 03f7db20-3934-4266-b84f-346a4ea22636 00010000:00010000:1.0:1789081601.821499:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789081601.933134:0:6607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 03f7db20-3934-4266-b84f-346a4ea22636 00010000:00010000:1.0:1789081602.846814:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081603.875444:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789081603.934376:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1028380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821276672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789081603.934471:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081603.934735:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821276672 00000100:00100000:0.0:1789081603.934747:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821276672 00000100:00100000:0.0:1789081603.934832:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789081603.934844:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821276672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789081603.934897:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789081603.934956:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821276672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081603.934964:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1789081603.935033:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10d1028380 x1875987821276672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081619 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081603.935075:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1028380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821276672:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789081603.935376:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789081604.448630:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789081604.448666:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1028380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821276800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789081604.448768:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081604.449055:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff5ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821276928:0@lo:400:kworker.0 00000100:00100000:3.0:1789081604.449094:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081604.449131:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff5df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875987821277440:0@lo:400:kworker.0 00000100:00100000:3.0:1789081604.449159:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081604.449180:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789081604.449185:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff5dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821277312:0@lo:400:kworker.0 00000100:00100000:3.0:1789081604.449211:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081604.449246:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821277312 00000100:00100000:3.0:1789081604.449255:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821277312 00000100:00100000:3.0:1789081604.449333:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789081604.449363:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff701500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821277312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081604.449429:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff701500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821277312:12345-0@lo:400:kworker.0 Request processed in 69us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081604.449438:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1789081604.449488:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10ff5dd180 x1875987821277312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789081620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789081604.449506:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff5dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821277312:0@lo:400:kworker.0 00000100:00100000:2.0:1789081604.449682:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821276928 00000100:00100000:2.0:1789081604.449688:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821276928 00000100:00100000:2.0:1789081604.449731:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789081604.449739:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3306:x1875987821276928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789081604.449781:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3306:x1875987821276928:12345-0@lo:400:kworker.0 Request processed in 43us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081604.449788:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789081604.449874:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821276800 00000100:00100000:0.0:1789081604.449880:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821276800 00000100:00100000:0.0:1789081604.449936:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789081604.449944:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff700a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821276800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789081604.449982:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789081604.450024:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff700a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821276800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (1256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081604.450030:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789081604.450060:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875987821277184:0@lo:400:kworker.0 00000100:00100000:0.0:1789081604.450092:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081604.450114:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789081604.450121:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875987821277056:0@lo:400:kworker.0 00000100:00100000:0.0:1789081604.450145:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081604.450249:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821277440 00000100:00100000:1.0:1789081604.450254:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821277440 00000100:00100000:1.0:1789081604.450297:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821277184 00000100:00100000:1.0:1789081604.450300:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821277184 00000100:00100000:1.0:1789081604.450336:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821277056 00000100:00100000:1.0:1789081604.450340:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821277056 00000100:00100000:1.0:1789081604.450355:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789081604.450363:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff700700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875987821277440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081604.450405:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff700700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875987821277440:12345-0@lo:400:kworker.0 Request processed in 44us (1245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081604.450412:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789081604.450439:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789081604.450445:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875987821277184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081604.450481:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875987821277184:12345-0@lo:400:kworker.0 Request processed in 36us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081604.450488:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789081604.450499:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789081604.450504:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d102bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875987821277056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081604.450562:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d102bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875987821277056:12345-0@lo:400:kworker.0 Request processed in 57us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081604.450568:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789081604.450608:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875987821277056:0@lo:400:kworker.0 00000100:00100000:1.0:1789081604.450620:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875987821277184:0@lo:400:kworker.0 00000100:00080000:2.0:1789081604.450750:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789081604.450757:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789081604.450841:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff5ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821276928:0@lo:400:kworker.0 00000100:00100000:3.0:1789081604.450855:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff5df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875987821277440:0@lo:400:kworker.0 00010000:00080000:3.0:1789081604.450871:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10d1028380 x1875987821276800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081620 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789081604.450891:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1028380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821276800:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789081604.892921:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789081605.087136:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081605.087424:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081605.087952:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796078592 00000100:00100000:3.0:1789081605.087962:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796078592 00000100:00100000:3.0:1789081605.088018:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 224 00000100:00100000:3.0:1789081605.088029:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2350:x1875987796078592:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081605.088096:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2350:x1875987796078592:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 69us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081605.088105:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 224 00000100:00100000:0.0:1789081605.088784:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796078848 00000100:00100000:0.0:1789081605.088792:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796078848 00000100:00100000:0.0:1789081605.088863:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 74 00000100:00100000:0.0:1789081605.088871:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03f7db20-3934-4266-b84f-346a4ea22636+5:2350:x1875987796078848:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:0.0:1789081605.088912:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03f7db20-3934-4266-b84f-346a4ea22636+5:2350:x1875987796078848:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 43us (1489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081605.088919:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 74 00000100:00080000:1.0:1789081605.089147:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789081605.095441:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081605.095485:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081605.095511:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081605.095654:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796079104 00000100:00100000:0.0:1789081605.095663:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796079104 00000100:00100000:0.0:1789081605.095722:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796078976 00000100:00100000:0.0:1789081605.095725:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796078976 00000100:00100000:0.0:1789081605.095758:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 26 00000100:00100000:0.0:1789081605.095767:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03f7db20-3934-4266-b84f-346a4ea22636+5:2350:x1875987796079104:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:0.0:1789081605.095837:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03f7db20-3934-4266-b84f-346a4ea22636+5:2350:x1875987796079104:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 70us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081605.095855:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 26 00000100:00100000:0.0:1789081605.095872:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 27 00000100:00100000:0.0:1789081605.095879:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03f7db20-3934-4266-b84f-346a4ea22636+5:2351:x1875987796078976:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:0.0:1789081605.095903:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03f7db20-3934-4266-b84f-346a4ea22636+5:2351:x1875987796078976:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 24us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081605.095909:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 27 00000100:00100000:2.0:1789081605.096413:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796078720 00000100:00100000:2.0:1789081605.096419:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796078720 00000100:00100000:2.0:1789081605.096460:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 75 00000100:00100000:2.0:1789081605.096468:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+6:2351:x1875987796078720:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:2.0:1789081605.096517:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+6:2351:x1875987796078720:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 50us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081605.096540:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 75 00000100:00080000:1.0:1789081605.096799:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789081605.096804:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789081605.096806:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:3.0:1789081605.660456:0:10170:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg117-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1789081605.916781:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081606.941691:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081607.968322:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081608.988912:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789081609.053677:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789081609.053701:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1028a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821277568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789081609.053769:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081609.053839:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821277568 00000100:00100000:0.0:1789081609.053847:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821277568 00000100:00100000:0.0:1789081609.053915:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789081609.053924:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1028700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821277568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789081609.053960:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789081609.054002:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1028700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821277568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081609.054010:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1789081609.054030:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789081609.054060:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10d1028a80 x1875987821277568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081625 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081609.054093:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1028a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821277568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789081609.566324:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821277696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789081609.567122:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081609.567500:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821277696 00000100:00100000:0.0:1789081609.567509:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821277696 00000100:00100000:0.0:1789081609.567588:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789081609.567598:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff702300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821277696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789081609.567987:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789081609.568049:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff702300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821277696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 453us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081609.568058:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1789081609.568081:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789081609.568344:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10ff703480 x1875987821277696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081625 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789081609.568716:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821277696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789081609.570241:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821277824:0@lo:400:kworker.0 00000100:00100000:3.0:1789081609.570315:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081609.570355:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875987821278336:0@lo:400:kworker.0 00000100:00100000:3.0:1789081609.571008:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081609.571036:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789081609.571043:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff701c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875987821277952:0@lo:400:kworker.0 00000100:00100000:3.0:1789081609.571063:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081609.571091:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875987821278080:0@lo:400:kworker.0 00000100:00100000:3.0:1789081609.571136:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081609.571965:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789081609.571975:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821278208:0@lo:400:kworker.0 00000100:00100000:3.0:1789081609.572007:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081609.572048:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821277824 00000100:00100000:3.0:1789081609.572056:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821277824 00000100:00100000:3.0:1789081609.572097:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789081609.572105:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3305:x1875987821277824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081609.572149:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3305:x1875987821277824:12345-0@lo:400:kworker.0 Request processed in 44us (1834us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081609.572551:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821278208 00000100:00100000:0.0:1789081609.572557:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821278208 00000100:00100000:0.0:1789081609.572588:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789081609.572593:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821278208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081609.572983:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789081609.573023:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821278336 00000100:00100000:3.0:1789081609.573028:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821278336 00000100:00100000:3.0:1789081609.573065:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821277952 00000100:00100000:3.0:1789081609.573069:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821277952 00000100:00100000:3.0:1789081609.573085:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821278080 00000100:00100000:3.0:1789081609.573094:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821278080 00000100:00100000:3.0:1789081609.573125:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789081609.573132:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff701f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875987821278336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789081609.573263:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789081609.573271:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff702680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875987821277952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081609.573333:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff701f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875987821278336:12345-0@lo:400:kworker.0 Request processed in 202us (2325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081609.573340:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789081609.573351:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789081609.573356:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875987821278080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081609.573397:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875987821278080:12345-0@lo:400:kworker.0 Request processed in 41us (2260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081609.573402:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1789081609.573426:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789081609.573458:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875987821278080:0@lo:400:kworker.0 00000100:00100000:3.0:1789081609.573482:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821277824:0@lo:400:kworker.0 00000100:00100000:3.0:1789081609.573491:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875987821278336:0@lo:400:kworker.0 00000100:00100000:0.0:1789081609.579990:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821278208:12345-0@lo:400:kworker.0 Request processed in 7383us (7969us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081609.580007:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1789081609.580080:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10ff702a00 x1875987821278208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789081625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081609.580096:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821278208:0@lo:400:kworker.0 00000100:00100000:2.0:1789081609.580344:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff702680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875987821277952:12345-0@lo:400:kworker.0 Request processed in 7072us (9278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081609.580354:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789081609.581014:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff701c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875987821277952:0@lo:400:kworker.0 00010000:00010000:1.0:1789081610.015400:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789081610.202015:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081610.202080:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081610.202120:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081610.202142:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081610.202170:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081610.202236:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796079616 00000100:00100000:0.0:1789081610.202248:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796079616 00000100:00100000:0.0:1789081610.202323:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796079744 00000100:00100000:0.0:1789081610.202327:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796079744 00000100:00100000:0.0:1789081610.202356:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 29 00000100:00100000:0.0:1789081610.202368:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1029500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03f7db20-3934-4266-b84f-346a4ea22636+5:2350:x1875987796079616:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:0.0:1789081610.202469:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1029500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03f7db20-3934-4266-b84f-346a4ea22636+5:2350:x1875987796079616:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 102us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081610.202477:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 29 00000100:00100000:0.0:1789081610.202508:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 30 00000100:00100000:0.0:1789081610.202515:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1029c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03f7db20-3934-4266-b84f-346a4ea22636+5:2350:x1875987796079744:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:0.0:1789081610.202576:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1029c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03f7db20-3934-4266-b84f-346a4ea22636+5:2350:x1875987796079744:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 61us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081610.202583:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 30 00000100:00100000:3.0:1789081610.203997:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796079360 00000100:00100000:3.0:1789081610.204011:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796079360 00000100:00100000:3.0:1789081610.204064:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796079488 00000100:00100000:3.0:1789081610.204068:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796079488 00000100:00100000:3.0:1789081610.204109:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 79 00000100:00100000:3.0:1789081610.204120:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1028a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+6:2350:x1875987796079360:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081610.204205:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1028a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+6:2350:x1875987796079360:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 87us (2202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081610.204224:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 79 00000100:00100000:3.0:1789081610.204242:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 80 00000100:00100000:3.0:1789081610.204264:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1028380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03f7db20-3934-4266-b84f-346a4ea22636+5:2350:x1875987796079488:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081610.204293:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1028380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03f7db20-3934-4266-b84f-346a4ea22636+5:2350:x1875987796079488:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 31us (2149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081610.204299:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 80 00000100:00100000:3.0:1789081610.204319:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796079232 00000100:00100000:3.0:1789081610.204323:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796079232 00000100:00100000:3.0:1789081610.204351:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 226 00000100:00100000:3.0:1789081610.204358:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2350:x1875987796079232:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081610.204385:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2350:x1875987796079232:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 28us (2265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081610.204391:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 226 00000100:00080000:3.0:1789081610.204427:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789081610.204432:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789081610.204435:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789081611.047487:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081612.061142:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081613.085753:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081614.114861:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081614.172889:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821278464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789081614.181799:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081614.191647:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821278464 00000100:00100000:0.0:1789081614.191669:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821278464 00000100:00100000:0.0:1789081614.191775:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789081614.191788:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821278464:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789081614.191892:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1789081614.191979:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789081614.192113:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821278464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 328us (10320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081614.192132:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1789081614.193061:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10f5c79f80 x1875987821278464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081630 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789081614.193086:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821278464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789081614.684959:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821278592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789081614.685031:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081614.685186:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821278592 00000100:00100000:1.0:1789081614.685195:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821278592 00000100:00100000:1.0:1789081614.685258:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789081614.685268:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821278592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789081614.685314:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789081614.685369:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821278592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081614.685376:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789081614.685842:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875987821278976:0@lo:400:kworker.0 00000100:00100000:0.0:1789081614.685895:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081614.685955:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789081614.685962:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875987821278848:0@lo:400:kworker.0 00000100:00100000:0.0:1789081614.685984:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789081614.690056:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789081614.690086:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821278720:0@lo:400:kworker.0 00000100:00100000:2.0:1789081614.690303:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081614.690338:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789081614.690347:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875987821279104:0@lo:400:kworker.0 00000100:00100000:2.0:1789081614.690376:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081614.692230:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821278720 00000100:00100000:3.0:1789081614.692244:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821278720 00000100:00100000:3.0:1789081614.692298:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1789081614.692307:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3304:x1875987821278720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081614.692377:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3304:x1875987821278720:12345-0@lo:400:kworker.0 Request processed in 71us (2074us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081614.692390:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00010000:00080000:3.0:1789081614.692865:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10ff780a80 x1875987821278592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081630 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789081614.692888:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821278592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789081614.694298:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821278976 00000100:00100000:1.0:1789081614.694312:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821278976 00000100:00100000:1.0:1789081614.694385:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821278848 00000100:00100000:1.0:1789081614.694776:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821278848 00000100:00100000:3.0:1789081614.694790:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789081614.694914:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875987821278976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081614.695019:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875987821278976:12345-0@lo:400:kworker.0 Request processed in 110us (9122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081614.695082:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875987821278976:0@lo:400:kworker.0 00000100:00100000:2.0:1789081614.697045:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821278720:0@lo:400:kworker.0 00000100:00080000:2.0:1789081614.697242:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789081614.697373:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821279104 00000100:00100000:0.0:1789081614.697380:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821279104 00000100:00080000:2.0:1789081614.697456:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789081614.698564:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789081614.698592:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875987821278848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081614.698688:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875987821278848:12345-0@lo:400:kworker.0 Request processed in 114us (12702us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081614.698697:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789081614.702204:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789081614.707275:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789081614.707309:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff5df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875987821279104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081614.707492:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff5df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875987821279104:12345-0@lo:400:kworker.0 Request processed in 203us (17112us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081614.707500:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789081614.707546:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875987821279104:0@lo:400:kworker.0 00000100:00100000:0.0:1789081614.707554:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875987821278848:0@lo:400:kworker.0 00010000:00010000:3.0:1789081615.132842:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789081615.332061:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081615.332104:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081615.332141:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081615.332176:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081615.332201:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081615.332227:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796080128 00000100:00100000:1.0:1789081615.332236:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796080128 00000100:00100000:1.0:1789081615.332300:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796080000 00000100:00100000:1.0:1789081615.332303:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796080000 00000100:00100000:1.0:1789081615.332329:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 84 00000100:00100000:1.0:1789081615.332339:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03f7db20-3934-4266-b84f-346a4ea22636+5:2350:x1875987796080128:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:1.0:1789081615.332425:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03f7db20-3934-4266-b84f-346a4ea22636+5:2350:x1875987796080128:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 87us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081615.332432:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 84 00000100:00100000:1.0:1789081615.332450:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 85 00000100:00100000:1.0:1789081615.332457:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+6:2350:x1875987796080000:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:1.0:1789081615.332491:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+6:2350:x1875987796080000:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 34us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081615.332496:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 85 00000100:00080000:1.0:1789081615.332517:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789081615.335265:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796080384 00000100:00100000:0.0:1789081615.335279:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796080384 00000100:00100000:0.0:1789081615.335370:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796080256 00000100:00100000:0.0:1789081615.335373:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796080256 00000100:00080000:2.0:1789081615.335466:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789081615.335470:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789081615.335564:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 31 00000100:00100000:0.0:1789081615.335573:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03f7db20-3934-4266-b84f-346a4ea22636+5:2350:x1875987796080384:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:0.0:1789081615.335637:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03f7db20-3934-4266-b84f-346a4ea22636+5:2350:x1875987796080384:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 66us (3495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081615.335644:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 31 00000100:00100000:0.0:1789081615.335659:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 32 00000100:00100000:0.0:1789081615.335664:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03f7db20-3934-4266-b84f-346a4ea22636+5:2350:x1875987796080256:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:0.0:1789081615.335683:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03f7db20-3934-4266-b84f-346a4ea22636+5:2350:x1875987796080256:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 19us (3482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081615.335698:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 32 00000100:00100000:3.0:1789081615.336728:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796079872 00000100:00100000:3.0:1789081615.336737:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796079872 00000100:00100000:3.0:1789081615.336785:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 228 00000100:00100000:3.0:1789081615.336794:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2350:x1875987796079872:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081615.336874:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2350:x1875987796079872:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 81us (4822us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081615.336881:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 228 00010000:00010000:0.0:1789081616.160394:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081617.194661:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081618.210158:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081619.229717:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789081619.293026:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d0ef3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821279232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789081619.293110:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081619.293445:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821279232 00000100:00100000:0.0:1789081619.293454:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821279232 00000100:00100000:0.0:1789081619.293553:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789081619.293564:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821279232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789081619.293607:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789081619.293801:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789081619.294259:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821279232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081619.294271:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1789081619.294334:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10d0ef3800 x1875987821279232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081635 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081619.294474:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d0ef3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821279232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789081619.804655:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789081619.804678:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d0ef3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821279360:0@lo:400:kworker.0 00000100:00100000:0.0:1789081619.804744:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081619.804809:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821279360 00000100:00100000:0.0:1789081619.804816:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821279360 00000100:00100000:0.0:1789081619.804856:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1789081619.804863:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3306:x1875987821279360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081619.804908:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3306:x1875987821279360:12345-0@lo:400:kworker.0 Request processed in 45us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081619.804914:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1789081619.804956:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d0ef3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821279360:0@lo:400:kworker.0 00000100:00100000:0.0:1789081619.805002:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d0ef3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875987821279488:0@lo:400:kworker.0 00000100:00100000:0.0:1789081619.807838:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081619.807974:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d0ef0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875987821279616:0@lo:400:kworker.0 00000100:00100000:0.0:1789081619.808017:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081619.808300:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821279488 00000100:00100000:1.0:1789081619.808310:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821279488 00000100:00100000:1.0:1789081619.808361:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821279616 00000100:00100000:1.0:1789081619.808365:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821279616 00000100:00100000:1.0:1789081619.808400:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789081619.808410:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875987821279488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789081619.810915:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789081619.810937:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875987821279616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081619.812177:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875987821279488:12345-0@lo:400:kworker.0 Request processed in 3761us (4339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081619.812189:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1789081619.812285:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789081619.814809:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875987821279616:12345-0@lo:400:kworker.0 Request processed in 3868us (6777us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081619.814828:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789081619.821707:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821279744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789081619.821793:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081619.821883:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821279744 00000100:00100000:0.0:1789081619.821892:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821279744 00000100:00100000:0.0:1789081619.821958:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789081619.821967:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821279744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789081619.822026:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789081619.822081:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821279744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081619.822089:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1789081619.822135:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10ff781180 x1875987821279744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081635 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081619.822157:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821279744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789081619.822198:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d0ef3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875987821279488:0@lo:400:kworker.0 00000100:00100000:0.0:1789081619.822261:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789081619.822268:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d0ef3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875987821279872:0@lo:400:kworker.0 00000100:00100000:0.0:1789081619.823095:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081619.823141:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821279872 00000100:00100000:0.0:1789081619.823147:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821279872 00000100:00100000:0.0:1789081619.823191:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789081619.823197:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875987821279872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081619.823257:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875987821279872:12345-0@lo:400:kworker.0 Request processed in 61us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081619.823265:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:1.0:1789081619.823401:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789081619.823406:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789081619.824464:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d0ef3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875987821279872:0@lo:400:kworker.0 00000100:00100000:2.0:1789081619.830048:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d0ef0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875987821279616:0@lo:400:kworker.0 00010000:00010000:3.0:1789081620.252741:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789081620.454136:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081620.454171:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081620.454238:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081620.454583:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796080512 00000100:00100000:3.0:1789081620.454594:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796080512 00000100:00100000:3.0:1789081620.454660:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 230 00000100:00100000:3.0:1789081620.454671:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2351:x1875987796080512:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081620.454743:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2351:x1875987796080512:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 73us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081620.454764:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 230 00000100:00100000:1.0:1789081620.458471:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081620.458506:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081620.458560:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796080896 00000100:00100000:1.0:1789081620.458571:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796080896 00000100:00100000:1.0:1789081620.458627:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796081024 00000100:00100000:1.0:1789081620.458630:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796081024 00000100:00100000:1.0:1789081620.458669:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 14 00000100:00100000:1.0:1789081620.458679:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03f7db20-3934-4266-b84f-346a4ea22636+5:2347:x1875987796080896:12345-192.168.201.17@tcp:9:kworker.0 00000020:00000080:1.0:1789081620.458710:0:6582:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb7cb3d7479d5f7eb 00000100:00080000:1.0:1789081620.458717:0:6582:0:(import.c:65:import_set_state_nolock()) ffff9e10f98e4000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789081620.458756:0:6582:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789081620.459130:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03f7db20-3934-4266-b84f-346a4ea22636+2:2347:x1875987796080896:12345-192.168.201.17@tcp:9:kworker.0 Request processed in 451us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081620.459139:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 14 00000100:00100000:1.0:1789081620.459156:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 15 00000100:00100000:1.0:1789081620.459164:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03f7db20-3934-4266-b84f-346a4ea22636+5:2347:x1875987796081024:12345-192.168.201.17@tcp:9:kworker.0 00000020:00000080:1.0:1789081620.459176:0:6582:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb7cb3d7479d5f7f2 00000100:00080000:1.0:1789081620.459182:0:6582:0:(import.c:65:import_set_state_nolock()) ffff9e10ff75e000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789081620.459205:0:6582:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789081620.459437:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03f7db20-3934-4266-b84f-346a4ea22636+2:2347:x1875987796081024:12345-192.168.201.17@tcp:9:kworker.0 Request processed in 273us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081620.459444:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 15 00000100:00080000:1.0:1789081620.459468:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789081620.459472:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789081620.459488:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081620.459617:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789081620.463980:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796080768 00000100:00100000:2.0:1789081620.463995:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796080768 00000100:00100000:2.0:1789081620.464080:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796080640 00000100:00100000:2.0:1789081620.464084:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796080640 00000100:00100000:2.0:1789081620.464129:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 89 00000100:00100000:2.0:1789081620.464138:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03f7db20-3934-4266-b84f-346a4ea22636+5:2351:x1875987796080768:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:2.0:1789081620.464219:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03f7db20-3934-4266-b84f-346a4ea22636+5:2351:x1875987796080768:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 81us (10046us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081620.464227:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 89 00000100:00100000:2.0:1789081620.464243:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 90 00000100:00100000:2.0:1789081620.464249:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+6:2351:x1875987796080640:12345-192.168.201.17@tcp:400:kworker.0 00000100:00080000:1.0:1789081620.464406:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789081620.464960:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+6:2351:x1875987796080640:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 710us (10721us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081620.464968:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 90 00010000:00010000:1.0:1789081621.276740:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789081621.449781:0:7493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 03f7db20-3934-4266-b84f-346a4ea22636 00000020:00000080:2.0:1789081621.449791:0:7493:0:(genops.c:906:class_export_put()) final put ffff9e10ff75f000/03f7db20-3934-4266-b84f-346a4ea22636 00000020:00000080:1.0:1789081621.450425:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e10ff75f000/03f7db20-3934-4266-b84f-346a4ea22636 for lustre-OST0001 00000020:00000080:1.0:1789081621.452250:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e10ff75e000 for lustre-OST0001 00010000:00010000:1.0:1789081622.302015:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789081622.431545:0:6607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 03f7db20-3934-4266-b84f-346a4ea22636 00000020:00000080:3.0:1789081622.431555:0:6607:0:(genops.c:906:class_export_put()) final put ffff9e10f98e6000/03f7db20-3934-4266-b84f-346a4ea22636 00000020:00000080:3.0:1789081622.431588:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e10f98e6000/03f7db20-3934-4266-b84f-346a4ea22636 for lustre-OST0000 00000020:00000080:3.0:1789081622.431635:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e10f98e4000 for lustre-OST0000 00010000:00010000:3.0:1789081623.337481:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081624.358071:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789081624.413187:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d0ef3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821280000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789081624.413296:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081624.413612:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821280000 00000100:00100000:0.0:1789081624.413623:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821280000 00000100:00080000:1.0:1789081624.413755:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789081624.413918:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789081624.413932:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff5df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821280000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789081624.413994:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789081624.414207:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff5df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821280000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 277us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081624.414216:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1789081624.420847:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10d0ef3800 x1875987821280000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081640 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789081624.420900:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d0ef3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821280000:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1789081624.536137:0:10873:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1789081624.925268:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d0ef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821280128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789081624.925360:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081624.925874:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821280128 00000100:00100000:0.0:1789081624.925885:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821280128 00000100:00100000:0.0:1789081624.925975:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789081624.925986:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821280128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789081624.926031:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789081624.926111:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821280128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081624.926119:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1789081624.926168:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10d0ef0700 x1875987821280128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081640 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081624.926188:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d0ef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821280128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789081624.926598:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5f05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875987821280384:0@lo:400:kworker.0 00000100:00100000:3.0:1789081624.926778:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5f06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821280256:0@lo:400:kworker.0 00000100:00100000:3.0:1789081624.926822:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081624.926923:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081624.926992:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5f06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875987821280512:0@lo:400:kworker.0 00000100:00100000:1.0:1789081624.927019:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081624.927659:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821280384 00000100:00100000:3.0:1789081624.927726:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821280384 00000100:00100000:3.0:1789081624.927771:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821280512 00000100:00100000:3.0:1789081624.927774:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821280512 00000100:00100000:3.0:1789081624.927798:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789081624.927807:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875987821280384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081624.927875:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875987821280384:12345-0@lo:400:kworker.0 Request processed in 70us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081624.927882:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789081624.927898:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789081624.927904:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875987821280512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081624.927936:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875987821280512:12345-0@lo:400:kworker.0 Request processed in 33us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081624.927942:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789081624.928008:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5f06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875987821280512:0@lo:400:kworker.0 00000100:00080000:2.0:1789081624.928265:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789081624.928270:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789081624.928476:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821280256 00000100:00100000:0.0:1789081624.928491:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821280256 00000100:00100000:0.0:1789081624.928550:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1789081624.928557:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3304:x1875987821280256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081624.928596:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3304:x1875987821280256:12345-0@lo:400:kworker.0 Request processed in 40us (1774us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081624.928602:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1789081624.928650:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5f05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875987821280640:0@lo:400:kworker.0 00000100:00100000:3.0:1789081624.928881:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5f05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875987821280384:0@lo:400:kworker.0 00000100:00100000:0.0:1789081624.928967:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081624.929083:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5f06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821280256:0@lo:400:kworker.0 00000100:00100000:3.0:1789081624.929259:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821280640 00000100:00100000:3.0:1789081624.929264:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821280640 00000100:00100000:3.0:1789081624.929318:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789081624.929325:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875987821280640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081624.929371:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875987821280640:12345-0@lo:400:kworker.0 Request processed in 47us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081624.929503:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5f05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875987821280640:0@lo:400:kworker.0 00000100:00080000:2.0:1789081624.929572:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789081624.929779:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00010000:1.0:1789081625.373878:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789081625.566376:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081625.566424:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081625.566452:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081625.566483:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796081152 00000100:00100000:1.0:1789081625.566496:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796081152 00000100:00100000:1.0:1789081625.566587:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 232 00000100:00100000:1.0:1789081625.566600:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2348:x1875987796081152:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:1.0:1789081625.566687:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2348:x1875987796081152:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 90us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081625.566696:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 232 00000100:00100000:1.0:1789081625.566733:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796081408 00000100:00100000:1.0:1789081625.566737:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796081408 00000100:00100000:1.0:1789081625.566775:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796081280 00000100:00100000:1.0:1789081625.566778:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796081280 00000100:00100000:1.0:1789081625.566797:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 94 00000100:00100000:1.0:1789081625.566802:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03f7db20-3934-4266-b84f-346a4ea22636+5:2348:x1875987796081408:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:1.0:1789081625.566832:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03f7db20-3934-4266-b84f-346a4ea22636+5:2348:x1875987796081408:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 30us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081625.566838:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 94 00000100:00100000:1.0:1789081625.566848:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 95 00000100:00100000:1.0:1789081625.566870:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+6:2348:x1875987796081280:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:1.0:1789081625.566893:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+6:2348:x1875987796081280:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 23us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081625.566899:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 95 00000100:00080000:1.0:1789081625.567054:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789081626.399013:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081627.422877:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081628.449981:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789081628.571100:0:11021:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd04763df0 20000000:00000080:3.0:1789081628.571120:0:11021:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e10d113b000 uarg=0000000000000000 20000000:01000000:3.0:1789081628.571158:0:11021:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789081628.571163:0:11021:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789081628.571169:0:11021:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789081628.573366:0:11022:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1789081628.573829:0:11021:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789081628.586370:0:11021:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789081628.588053:0:11021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e10c29e0000/0xb7cb3d7479d5f7f9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081628.588076:0:11021:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e1101998e00/0xb7cb3d7479d5f79e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a79a expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081628.588104:0:11021:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e1101999000/0xb7cb3d7479d5f7ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f7a5 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081628.588111:0:11021:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e10c1486400/0xb7cb3d7479d5f7ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f7b3 expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081628.588117:0:11021:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e10e13af600/0xb7cb3d7479d5f7c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f7c1 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081628.588125:0:11021:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e10e13afa00/0xb7cb3d7479d5f7dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a7d2 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081628.588131:0:11021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e10c29e0000/0xb7cb3d7479d5f7f9 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081628.588170:0:11021:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e10e13afa00/0xb7cb3d7479d5f7dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a7d2 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081628.588184:0:11021:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e10e13afa00/0xb7cb3d7479d5f7dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a7d2 expref: 12 pid: 5783 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081628.588199:0:11021:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff5dd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11021:1875987821280768:192.168.201.17@tcp:104: 00010000:00010000:2.0:1789081628.589856:0:11021:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e10e13af600/0xb7cb3d7479d5f7c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb7cb3d7479d5f7c1 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081628.589872:0:11021:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e10e13af600/0xb7cb3d7479d5f7c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f7c1 expref: 18 pid: 5784 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081628.589961:0:11021:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff5de300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11021:1875987821280896:0@lo:104: 00000100:00100000:2.0:1789081628.590026:0:11021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081628.594870:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081628.597856:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821280896 00000100:00100000:0.0:1789081628.597871:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821280896 00000100:00100000:0.0:1789081628.597958:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789081628.597968:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+3:11021:x1875987821280896:12345-0@lo:104: 00010000:00010000:0.0:1789081628.597986:0:5772:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.117@tcp lock: ffff9e10e13aec00/0xb7cb3d7479d5f7c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f7c8 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081628.598071:0:5772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789081628.598077:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+3:11021:x1875987821280896:12345-0@lo:104: Request processed in 111us (8051us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081628.598085:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1789081628.598207:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789081628.598214:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e10e13aec00/0xb7cb3d7479d5f7c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f7c8 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081628.598233:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13aec00 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:1.0:1789081628.598238:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e10e13aec00/0xb7cb3d7479d5f7c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb7cb3d7479d5f7c8 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081628.598246:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e10e13aec00/0xb7cb3d7479d5f7c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb7cb3d7479d5f7c8 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789081628.598255:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e10e13aec00/0xb7cb3d7479d5f7c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb7cb3d7479d5f7c8 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789081628.598260:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789081628.598301:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e10e13aec00/0xb7cb3d7479d5f7c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f7c8 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081628.598308:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789081628.598329:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e10e13aec00/0xb7cb3d7479d5f7c1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f7c8 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081628.598355:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e10e13aec00/0xb7cb3d7479d5f7c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f7c8 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081628.598369:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081628.598371:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081628.598373:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789081628.598386:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5f07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821281024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789081628.598424:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081628.598519:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796081536 00000100:00100000:0.0:1789081628.598546:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796081536 00010000:00010000:0.0:1789081628.598568:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e10e13afa00/0xb7cb3d7479d5f7dd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a7d2 expref: 13 pid: 5783 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081628.598591:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821281024 00000100:00100000:0.0:1789081628.598601:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821281024 00010000:00010000:0.0:1789081628.598615:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e10e13af600/0xb7cb3d7479d5f7c8 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f7c1 expref: 19 pid: 5784 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081628.598635:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 25 00000100:00100000:0.0:1789081628.598643:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c938a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2350:x1875987796081536:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789081628.598653:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789081628.598659:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e10e13afa00/0xb7cb3d7479d5f7dd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a7d2 expref: 13 pid: 5783 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081628.598669:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e10e13afa00/0xb7cb3d7479d5f7dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a7d2 expref: 13 pid: 5783 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081628.599404:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789081628.599463:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c938a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2350:x1875987796081536:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 818us (4601us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081628.599472:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 25 00000100:00100000:0.0:1789081628.599553:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789081628.599562:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3304:x1875987821281024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789081628.599572:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789081628.599578:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e10e13af600/0xb7cb3d7479d5f7c8 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f7c1 expref: 19 pid: 5784 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081628.599588:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e10e13af600/0xb7cb3d7479d5f7c8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f7c1 expref: 19 pid: 5784 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081628.599600:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789081628.599629:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3304:x1875987821281024:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081628.599647:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1789081628.601336:0:11021:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e10c1486400/0xb7cb3d7479d5f7ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb7cb3d7479d5f7b3 expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081628.601353:0:11021:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e10c1486400/0xb7cb3d7479d5f7ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f7b3 expref: 18 pid: 5782 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081628.601368:0:11021:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11021:1875987821281152:0@lo:104: 00000100:00100000:2.0:1789081628.601415:0:11021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789081628.601444:0:11021:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e1101999000/0xb7cb3d7479d5f7ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb7cb3d7479d5f7a5 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081628.601451:0:11021:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e1101999000/0xb7cb3d7479d5f7ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f7a5 expref: 18 pid: 5783 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081628.601458:0:11021:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11021:1875987821281280:0@lo:104: 00000100:00100000:2.0:1789081628.601477:0:11021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789081628.601535:0:11021:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e1101998e00/0xb7cb3d7479d5f79e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a79a expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081628.601547:0:11021:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e1101998e00/0xb7cb3d7479d5f79e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a79a expref: 12 pid: 5784 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081628.601557:0:11021:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11021:1875987821281408:192.168.201.17@tcp:104: 00000100:00100000:2.0:1789081628.601606:0:11021:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10f97fccc0 going to sleep for 11 seconds 00010000:00010000:2.0:1789081628.601632:0:11021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10e13afa00/0xb7cb3d7479d5f7dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a7d2 expref: 12 pid: 5783 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081628.601645:0:11021:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff5dd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11021:1875987821280768:192.168.201.17@tcp:104: 00010000:00010000:2.0:1789081628.601668:0:11021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10e13af600/0xb7cb3d7479d5f7c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb7cb3d7479d5f7c1 expref: 18 pid: 5784 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081628.601676:0:11021:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff5de300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11021:1875987821280896:0@lo:104: 00000100:00100000:0.0:1789081628.602086:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821281152 00000100:00100000:0.0:1789081628.602094:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821281152 00000100:00100000:0.0:1789081628.602129:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821281280 00000100:00100000:0.0:1789081628.602133:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821281280 00000100:00100000:0.0:1789081628.602146:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789081628.602154:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+4:11021:x1875987821281152:12345-0@lo:104: 00010000:00010000:0.0:1789081628.602165:0:5772:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.117@tcp lock: ffff9e10c1486e00/0xb7cb3d7479d5f7b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f7ba expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081628.602232:0:5772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789081628.602238:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+4:11021:x1875987821281152:12345-0@lo:104: Request processed in 85us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081628.602244:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789081628.602260:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789081628.602265:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+3:11021:x1875987821281280:12345-0@lo:104: 00010000:00010000:0.0:1789081628.602272:0:5772:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0400/0xb7cb3d7479d5f7a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f7ac expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081628.602307:0:5772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789081628.602312:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+3:11021:x1875987821281280:12345-0@lo:104: Request processed in 47us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081628.602317:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1789081628.602439:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789081628.602445:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e10c1486e00/0xb7cb3d7479d5f7b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f7ba expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081628.602452:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10c1486e00 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:0.0:1789081628.602463:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e10c1486e00/0xb7cb3d7479d5f7b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb7cb3d7479d5f7ba expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081628.602473:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e10c1486e00/0xb7cb3d7479d5f7b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb7cb3d7479d5f7ba expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789081628.602480:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e10c1486e00/0xb7cb3d7479d5f7b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb7cb3d7479d5f7ba expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789081628.602486:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789081628.605155:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e10c1486e00/0xb7cb3d7479d5f7b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f7ba expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081628.605170:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789081628.605197:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e10c1486e00/0xb7cb3d7479d5f7b3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f7ba expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081628.605204:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e10c1486e00/0xb7cb3d7479d5f7b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f7ba expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081628.605362:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1789081628.605807:0:11021:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11021:1875987821281152:0@lo:104: 00000100:00100000:2.0:1789081628.605825:0:11021:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11021:1875987821281280:0@lo:104: 00010000:00010000:0.0:1789081628.605953:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0400/0xb7cb3d7479d5f7a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f7ac expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081628.605964:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10c29e0400 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:0.0:1789081628.605968:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0400/0xb7cb3d7479d5f7a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb7cb3d7479d5f7ac expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081628.605978:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0400/0xb7cb3d7479d5f7a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb7cb3d7479d5f7ac expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789081628.606004:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0400/0xb7cb3d7479d5f7a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb7cb3d7479d5f7ac expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789081628.606010:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789081628.606037:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0400/0xb7cb3d7479d5f7a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f7ac expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081628.606043:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789081628.606052:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0400/0xb7cb3d7479d5f7a5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f7ac expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081628.606058:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0400/0xb7cb3d7479d5f7a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f7ac expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081628.606074:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081628.606076:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081628.606078:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789081628.606093:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d0ef1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821281536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789081628.606157:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081628.606215:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1789081628.606379:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789081628.607056:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821281536 00000100:00100000:2.0:1789081628.607065:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821281536 00010000:00010000:2.0:1789081628.607101:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e10c1486400/0xb7cb3d7479d5f7ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f7b3 expref: 18 pid: 5782 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081628.607142:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789081628.607150:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:3305:x1875987821281536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789081628.607162:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789081628.607166:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e10c1486400/0xb7cb3d7479d5f7ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f7b3 expref: 18 pid: 5782 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081628.607176:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e10c1486400/0xb7cb3d7479d5f7ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f7b3 expref: 18 pid: 5782 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081628.607190:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10c1486400/0xb7cb3d7479d5f7ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb7cb3d7479d5f7b3 expref: 18 pid: 5782 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081628.607206:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789081628.607596:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d0ef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821281664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789081628.607647:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081628.607797:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:3305:x1875987821281536:12345-0@lo:103:ldlm_bl.0 Request processed in 647us (1639us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081628.607806:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789081628.607826:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821281664 00000100:00100000:2.0:1789081628.607830:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821281664 00010000:00010000:2.0:1789081628.607859:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e1101999000/0xb7cb3d7479d5f7ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f7a5 expref: 17 pid: 5783 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081628.608011:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789081628.608022:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:3305:x1875987821281664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789081628.608032:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789081628.608038:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e1101999000/0xb7cb3d7479d5f7ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f7a5 expref: 17 pid: 5783 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081628.608048:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e1101999000/0xb7cb3d7479d5f7ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f7a5 expref: 17 pid: 5783 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081628.608063:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e1101999000/0xb7cb3d7479d5f7ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb7cb3d7479d5f7a5 expref: 17 pid: 5783 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081628.608075:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789081628.608102:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:3305:x1875987821281664:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081628.608142:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d0ef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821281664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789081628.608152:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d0ef1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821281536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789081628.608295:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081628.608312:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796081664 00000100:00100000:0.0:1789081628.608316:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796081664 00010000:00010000:0.0:1789081628.608342:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e1101998e00/0xb7cb3d7479d5f79e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a79a expref: 12 pid: 5784 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081628.611083:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5f07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821281024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789081628.611662:0:11021:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11021:1875987821281408:192.168.201.17@tcp:104: 00010000:00010000:1.0:1789081628.611708:0:11021:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e10c29e0000/0xb7cb3d7479d5f7f9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081628.616819:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789081628.619928:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 29 00000100:00100000:1.0:1789081628.619949:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+12:2350:x1875987796081664:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789081628.619976:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789081628.619987:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e1101998e00/0xb7cb3d7479d5f79e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a79a expref: 12 pid: 5784 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081628.620001:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e1101998e00/0xb7cb3d7479d5f79e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a79a expref: 12 pid: 5784 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081628.620021:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e1101998e00/0xb7cb3d7479d5f79e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a79a expref: 12 pid: 5784 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081628.620037:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e10c29e0000/0xb7cb3d7479d5f7f9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081628.620060:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10c29e0000/0xb7cb3d7479d5f7f9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081628.620078:0:5774:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e10c29e0000/0xb7cb3d7479d5f7f9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081628.620086:0:5774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e10c29e0000/0xb7cb3d7479d5f7f9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081628.620093:0:5774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e10c29e0000/0xb7cb3d7479d5f7f9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081628.620102:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e10c29e0000/0xb7cb3d7479d5f7f9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081628.620108:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10c29e0000 already unused, calling callback (ffffffffc1784220) 00010000:00010000:1.0:1789081628.620112:0:5774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e10c29e0000/0xb7cb3d7479d5f7f9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081628.620120:0:5774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e10c29e0000/0xb7cb3d7479d5f7f9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081628.620142:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e10c29e0000/0xb7cb3d7479d5f7f9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081628.620153:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789081628.620218:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+11:2350:x1875987796081664:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 278us (11924us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081628.620225:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 29 00010000:00010000:2.0:1789081628.620282:0:11021:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e10c29e0000/0xb7cb3d7479d5f7f9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081628.620291:0:11021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e10c29e0000/0xb7cb3d7479d5f7f9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081628.620298:0:11021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10c29e0000/0xb7cb3d7479d5f7f9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081629.468794:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789081629.536586:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789081629.536614:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d0ef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821281792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789081629.536693:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081629.536900:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821281792 00000100:00100000:3.0:1789081629.536909:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821281792 00000100:00100000:3.0:1789081629.536976:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789081629.536986:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821281792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789081629.537024:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789081629.538705:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821281792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1711us (2001us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081629.538720:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1789081629.539273:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789081629.539339:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10d0ef3480 x1875987821281792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081645 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789081629.539368:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d0ef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821281792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789081630.044850:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789081630.044889:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d0ef0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821281920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789081630.044985:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081630.045121:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821281920 00000100:00100000:0.0:1789081630.045130:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821281920 00000100:00100000:0.0:1789081630.045199:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789081630.045208:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821281920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789081630.045251:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789081630.045300:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821281920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081630.045307:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1789081630.045390:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10d0ef0000 x1875987821281920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081646 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789081630.045420:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d0ef0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821281920:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789081630.045483:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789081630.046630:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875987821282432:0@lo:400:kworker.0 00000100:00100000:2.0:1789081630.046699:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081630.046728:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789081630.046733:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875987821282304:0@lo:400:kworker.0 00000100:00100000:2.0:1789081630.046754:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081630.046782:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821282432 00000100:00100000:2.0:1789081630.046788:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821282432 00000100:00100000:2.0:1789081630.046830:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821282304 00000100:00100000:2.0:1789081630.046833:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821282304 00000100:00100000:2.0:1789081630.046853:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789081630.046871:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875987821282432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789081630.046914:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875987821282432:12345-0@lo:400:kworker.0 Request processed in 43us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081630.046920:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789081630.046933:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789081630.046938:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875987821282304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789081630.046973:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875987821282304:12345-0@lo:400:kworker.0 Request processed in 35us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081630.046979:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:2.0:1789081630.047000:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789081630.047025:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875987821282304:0@lo:400:kworker.0 00000100:00100000:2.0:1789081630.047035:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875987821282432:0@lo:400:kworker.0 00000100:00100000:3.0:1789081630.047288:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875987821282176:0@lo:400:kworker.0 00000100:00100000:3.0:1789081630.047316:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081630.047372:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789081630.047379:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821282048:0@lo:400:kworker.0 00000100:00100000:3.0:1789081630.047406:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081630.047441:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821282176 00000100:00100000:3.0:1789081630.047445:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821282176 00000100:00100000:3.0:1789081630.047472:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789081630.047478:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875987821282176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081630.047512:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875987821282176:12345-0@lo:400:kworker.0 Request processed in 35us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081630.047519:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789081630.047565:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821282048 00000100:00100000:3.0:1789081630.047569:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821282048 00000100:00100000:3.0:1789081630.047594:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1789081630.047600:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:3306:x1875987821282048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081630.047629:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:3306:x1875987821282048:12345-0@lo:400:kworker.0 Request processed in 30us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081630.047635:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1789081630.047669:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821282048:0@lo:400:kworker.0 00000100:00100000:3.0:1789081630.047679:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875987821282176:0@lo:400:kworker.0 10000000:01000000:2.0:1789081630.251376:0:5786:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789081630.251384:0:5786:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e10ff7e6800 from 7 10000000:01000000:2.0:1789081630.251389:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789081630.251434:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0000/0xb7cb3d7479d5f800 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081630.251459:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0000/0xb7cb3d7479d5f800 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081630.251470:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0000/0xb7cb3d7479d5f800 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081630.251498:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821282560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789081630.251593:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081630.251644:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10f97fc180 going to sleep for 11 seconds 00000100:00100000:2.0:1789081630.252651:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821282560 00000100:00100000:2.0:1789081630.252661:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821282560 00000100:00100000:2.0:1789081630.252720:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789081630.252729:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:5786:x1875987821282560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789081630.252745:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081630.252762:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10c29e0400/0xb7cb3d7479d5f807 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f800 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081630.252791:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10c29e0400/0xb7cb3d7479d5f807 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f800 expref: 17 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081630.252802:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10c29e0400/0xb7cb3d7479d5f807 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f800 expref: 17 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081630.252812:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10c29e0400, rc 0) 00000100:00100000:2.0:1789081630.252880:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:5786:x1875987821282560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (1286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081630.252887:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789081630.252950:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821282560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789081630.252966:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0000/0xb7cb3d7479d5f800 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f807 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081630.252975:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0000/0xb7cb3d7479d5f800 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f807 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081630.253038:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821282688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789081630.253070:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081630.253086:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10f97fc180 going to sleep for 11 seconds 00000100:00100000:2.0:1789081630.253100:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821282688 00000100:00100000:2.0:1789081630.253104:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821282688 00000100:00100000:2.0:1789081630.253124:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789081630.253129:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:5786:x1875987821282688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789081630.253377:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:5786:x1875987821282688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 245us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081630.253385:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789081630.253417:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821282688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789081630.253445:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821282816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789081630.253479:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081630.253494:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10f97fc180 going to sleep for 11 seconds 00000100:00100000:2.0:1789081630.253506:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821282816 00000100:00100000:2.0:1789081630.253509:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821282816 00000100:00100000:2.0:1789081630.253553:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789081630.253559:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:5786:x1875987821282816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789081630.253698:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:5786:x1875987821282816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081630.253709:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789081630.253746:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821282816:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789081630.254410:0:11069:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789081630.254471:0:5786:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789081630.254487:0:5786:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789081630.254497:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0000/0xb7cb3d7479d5f800 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f807 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081630.254507:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0000/0xb7cb3d7479d5f800 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f807 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789081630.254517:0:5786:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789081630.254520:0:5786:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e10fad3e000 from 7 10000000:01000000:2.0:1789081630.254548:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789081630.254578:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1c00/0xb7cb3d7479d5f80e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081630.254586:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1c00/0xb7cb3d7479d5f80e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081630.254595:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1c00/0xb7cb3d7479d5f80e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081630.254612:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821282944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789081630.254653:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081630.254671:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10f97fc780 going to sleep for 11 seconds 00000100:00100000:2.0:1789081630.254688:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821282944 00000100:00100000:2.0:1789081630.254692:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821282944 00000100:00100000:2.0:1789081630.254721:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789081630.254738:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:5786:x1875987821282944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789081630.254749:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081630.254760:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10c29e0600/0xb7cb3d7479d5f815 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f80e expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081630.254777:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10c29e0600/0xb7cb3d7479d5f815 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f80e expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081630.254786:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10c29e0600/0xb7cb3d7479d5f815 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f80e expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081630.254793:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10c29e0600, rc 0) 00000100:00100000:2.0:1789081630.254821:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:5786:x1875987821282944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081630.254828:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789081630.254877:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821282944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789081630.254887:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1c00/0xb7cb3d7479d5f80e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f815 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081630.254895:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1c00/0xb7cb3d7479d5f80e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f815 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081630.254932:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821283072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789081630.254955:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081630.254968:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10f97fc780 going to sleep for 11 seconds 00000100:00100000:2.0:1789081630.254980:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821283072 00000100:00100000:2.0:1789081630.254983:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821283072 00000100:00100000:2.0:1789081630.255002:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789081630.255015:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:5786:x1875987821283072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789081630.255224:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:5786:x1875987821283072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 210us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081630.255231:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789081630.255259:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821283072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789081630.255282:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821283200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789081630.255317:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081630.255329:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10f97fc780 going to sleep for 11 seconds 00000100:00100000:2.0:1789081630.255341:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821283200 00000100:00100000:2.0:1789081630.255344:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821283200 00000100:00100000:2.0:1789081630.255363:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789081630.255369:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:5786:x1875987821283200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789081630.255493:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:5786:x1875987821283200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081630.255500:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789081630.255561:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821283200:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789081630.263090:0:11070:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789081630.263246:0:5786:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789081630.263268:0:5786:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789081630.263279:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1c00/0xb7cb3d7479d5f80e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f815 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081630.263302:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1c00/0xb7cb3d7479d5f80e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f815 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789081630.263313:0:5786:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789081630.263315:0:5786:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e10ee974800 from 7 10000000:01000000:2.0:1789081630.263327:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789081630.263383:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101775600/0xb7cb3d7479d5f81c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081630.263391:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e1101775600/0xb7cb3d7479d5f81c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081630.263401:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e1101775600/0xb7cb3d7479d5f81c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081630.263426:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821283328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789081630.263491:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081630.263554:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10f97fc780 going to sleep for 11 seconds 00000100:00100000:3.0:1789081630.263668:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821283328 00000100:00100000:3.0:1789081630.263675:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821283328 00000100:00100000:3.0:1789081630.263720:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1789081630.263729:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:5786:x1875987821283328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789081630.263741:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081630.263754:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e1101998a00/0xb7cb3d7479d5f823 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f81c expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081630.263777:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e1101998a00/0xb7cb3d7479d5f823 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f81c expref: 19 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081630.263787:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e1101998a00/0xb7cb3d7479d5f823 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f81c expref: 19 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081630.263794:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101998a00, rc 0) 00000100:00100000:3.0:1789081630.263832:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:5786:x1875987821283328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081630.263838:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1789081630.264382:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821283328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789081630.264403:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e1101775600/0xb7cb3d7479d5f81c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f823 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081630.264412:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e1101775600/0xb7cb3d7479d5f81c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f823 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081630.264463:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821283456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789081630.264493:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081630.264556:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10f97fc780 going to sleep for 11 seconds 00000100:00100000:0.0:1789081630.264742:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821283456 00000100:00100000:0.0:1789081630.264747:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821283456 00000100:00100000:0.0:1789081630.264783:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789081630.264790:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ffa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:5786:x1875987821283456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789081630.265056:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ffa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:5786:x1875987821283456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 266us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081630.265064:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789081630.267618:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821283456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789081630.267688:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5f05880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821283584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789081630.267770:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081630.267796:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d106d240 going to sleep for 11 seconds 00000100:00100000:2.0:1789081630.268122:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821283584 00000100:00100000:2.0:1789081630.268130:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821283584 00000100:00100000:2.0:1789081630.268188:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1789081630.268197:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:5786:x1875987821283584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789081630.268459:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:5786:x1875987821283584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 263us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081630.268474:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789081630.268754:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5f05880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821283584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789081630.274087:0:11074:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789081630.275219:0:5786:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789081630.275247:0:5786:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789081630.275259:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101775600/0xb7cb3d7479d5f81c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f823 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081630.275272:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e1101775600/0xb7cb3d7479d5f81c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f823 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081630.425233:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081630.427909:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796081792 00000100:00100000:3.0:1789081630.427926:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796081792 00000100:00100000:3.0:1789081630.428067:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 243 00000100:00100000:3.0:1789081630.428079:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+11:5569:x1875987796081792:12345-192.168.201.17@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789081630.428096:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081630.428125:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e1101998000/0xb7cb3d7479d5f82a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a7fc expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081630.428156:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e1101998000/0xb7cb3d7479d5f82a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a7fc expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081630.428177:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e1101998000/0xb7cb3d7479d5f82a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a7fc expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081630.428188:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101998000, rc 0) 00000100:00100000:3.0:1789081630.428275:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+12:5569:x1875987796081792:12345-192.168.201.17@tcp:101:ll_cfg_requeue.0 Request processed in 197us (3053us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081630.428284:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 243 00000100:00100000:0.0:1789081630.440297:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081630.440419:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796081920 00000100:00100000:1.0:1789081630.440432:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796081920 00000100:00100000:1.0:1789081630.440501:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 244 00000100:00100000:1.0:1789081630.440511:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+12:5569:x1875987796081920:12345-192.168.201.17@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789081630.440914:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+12:5569:x1875987796081920:12345-192.168.201.17@tcp:501:ll_cfg_requeue.0 Request processed in 402us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081630.440922:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 244 00000100:00100000:1.0:1789081630.453299:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081630.453390:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796082048 00000100:00100000:3.0:1789081630.453400:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796082048 00000100:00100000:3.0:1789081630.453464:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 245 00000100:00100000:3.0:1789081630.453484:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+12:5569:x1875987796082048:12345-192.168.201.17@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789081630.453762:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+12:5569:x1875987796082048:12345-192.168.201.17@tcp:503:ll_cfg_requeue.0 Request processed in 288us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081630.453770:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 245 00000100:00100000:1.0:1789081630.489073:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081630.489210:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796082176 00000100:00100000:0.0:1789081630.489292:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796082176 00000100:00100000:0.0:1789081630.490929:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 246 00000100:00100000:0.0:1789081630.490953:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+12:5569:x1875987796082176:12345-192.168.201.17@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789081630.490974:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081630.490998:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10c1487e00/0xb7cb3d7479d5f831 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a803 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081630.491031:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10c1487e00/0xb7cb3d7479d5f831 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a803 expref: 13 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081630.491045:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10c1487e00/0xb7cb3d7479d5f831 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a803 expref: 13 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081630.491055:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10c1487e00, rc 0) 00000100:00100000:0.0:1789081630.491121:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:5569:x1875987796082176:12345-192.168.201.17@tcp:101:ll_cfg_requeue.0 Request processed in 179us (2057us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081630.491129:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 246 00000100:00100000:3.0:1789081630.496896:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081630.496999:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796082304 00000100:00100000:2.0:1789081630.497010:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796082304 00000100:00100000:2.0:1789081630.497067:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 247 00000100:00100000:2.0:1789081630.497076:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ffb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:5569:x1875987796082304:12345-192.168.201.17@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789081630.507028:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ffb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:5569:x1875987796082304:12345-192.168.201.17@tcp:501:ll_cfg_requeue.0 Request processed in 9940us (10553us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081630.507044:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 247 00000100:00100000:2.0:1789081630.509316:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00010000:00010000:1.0:1789081630.509901:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081630.510920:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796082432 00000100:00100000:3.0:1789081630.511539:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796082432 00000100:00100000:1.0:1789081630.511676:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 248 00000100:00100000:1.0:1789081630.511686:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:5569:x1875987796082432:12345-192.168.201.17@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789081630.511929:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:5569:x1875987796082432:12345-192.168.201.17@tcp:503:ll_cfg_requeue.0 Request processed in 243us (2620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081630.511938:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 248 00000100:00100000:3.0:1789081630.680882:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081630.681701:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081630.692801:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796082560 00000100:00100000:2.0:1789081630.692819:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796082560 00000100:00100000:2.0:1789081630.692926:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796082688 00000100:00100000:2.0:1789081630.692931:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796082688 00000100:00100000:2.0:1789081630.692961:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 99 00000100:00100000:2.0:1789081630.692972:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+6:2349:x1875987796082560:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:2.0:1789081630.693068:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+6:2349:x1875987796082560:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 98us (12195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081630.693076:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 99 00000100:00100000:2.0:1789081630.693094:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 100 00000100:00100000:2.0:1789081630.693101:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03f7db20-3934-4266-b84f-346a4ea22636+5:2349:x1875987796082688:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:2.0:1789081630.693127:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03f7db20-3934-4266-b84f-346a4ea22636+5:2349:x1875987796082688:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 27us (11429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081630.693133:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 100 00000100:00080000:2.0:1789081630.703396:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789081631.517624:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081632.543003:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789081633.412077:0:11219:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg117-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789081633.564975:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081634.591108:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081634.653288:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d0ef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821283712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789081634.653360:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081634.653496:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821283712 00000100:00100000:0.0:1789081634.653505:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821283712 00000100:00100000:0.0:1789081634.653576:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789081634.653585:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821283712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789081634.653620:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789081634.653678:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821283712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081634.653685:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1789081634.653878:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789081634.653952:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10d0ef2a00 x1875987821283712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081650 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789081634.653972:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d0ef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821283712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789081635.165369:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101b14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821283840:0@lo:400:kworker.0 00000100:00100000:2.0:1789081635.165449:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081635.165502:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875987821284352:0@lo:400:kworker.0 00000100:00100000:2.0:1789081635.165549:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081635.165576:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789081635.165582:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821284224:0@lo:400:kworker.0 00000100:00100000:2.0:1789081635.165606:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081635.165638:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821283840 00000100:00100000:2.0:1789081635.165657:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821283840 00000100:00100000:2.0:1789081635.165702:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1789081635.165711:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3306:x1875987821283840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789081635.165762:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3306:x1875987821283840:12345-0@lo:400:kworker.0 Request processed in 52us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081635.165783:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1789081635.165827:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101b14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821283840:0@lo:400:kworker.0 00000100:00100000:2.0:1789081635.165860:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875987821284096:0@lo:400:kworker.0 00000100:00100000:2.0:1789081635.165881:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081635.165905:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821284352 00000100:00100000:2.0:1789081635.165908:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821284352 00000100:00100000:2.0:1789081635.165935:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821284096 00000100:00100000:2.0:1789081635.165937:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821284096 00000100:00100000:2.0:1789081635.165952:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789081635.165957:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875987821284352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789081635.165986:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875987821284352:12345-0@lo:400:kworker.0 Request processed in 29us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081635.166136:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789081635.166150:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789081635.166156:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875987821284096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789081635.166186:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875987821284096:12345-0@lo:400:kworker.0 Request processed in 32us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081635.166192:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:2.0:1789081635.166208:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789081635.166224:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875987821284096:0@lo:400:kworker.0 00000100:00100000:2.0:1789081635.166243:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875987821284352:0@lo:400:kworker.0 00000100:00100000:0.0:1789081635.166394:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d0ef2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821284608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789081635.166430:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081635.166456:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821284608 00000100:00100000:0.0:1789081635.166459:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821284608 00000100:00100000:0.0:1789081635.166487:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789081635.166492:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821284608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789081635.166518:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789081635.166564:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821284608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081635.166570:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1789081635.166585:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789081635.166599:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10d0ef2d80 x1875987821284608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081651 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081635.166615:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d0ef2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821284608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789081635.166743:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101b14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875987821283968:0@lo:400:kworker.0 00000100:00100000:3.0:1789081635.166781:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081635.166807:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821284480:0@lo:400:kworker.0 00000100:00100000:3.0:1789081635.166824:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081635.166937:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821284224 00000100:00100000:1.0:1789081635.166941:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821284224 00000100:00100000:1.0:1789081635.166963:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821284480 00000100:00100000:1.0:1789081635.166966:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821284480 00000100:00100000:1.0:1789081635.166980:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789081635.166986:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821284224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081635.167081:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789081635.167089:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821284480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081635.167125:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821284480:12345-0@lo:400:kworker.0 Request processed in 37us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081635.167130:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1789081635.167154:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e1101b15c00 x1875987821284480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789081651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789081635.167164:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821284480:0@lo:400:kworker.0 00000100:00100000:3.0:1789081635.167189:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821283968 00000100:00100000:3.0:1789081635.167192:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821283968 00000100:00100000:3.0:1789081635.167212:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789081635.167217:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875987821283968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081635.167245:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875987821283968:12345-0@lo:400:kworker.0 Request processed in 28us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081635.167251:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789081635.167343:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101b14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875987821283968:0@lo:400:kworker.0 00000100:00100000:1.0:1789081635.167428:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821284224:12345-0@lo:400:kworker.0 Request processed in 442us (1821us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081635.167434:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1789081635.168156:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e1101b17480 x1875987821284224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789081651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789081635.168169:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821284224:0@lo:400:kworker.0 00010000:00010000:3.0:1789081635.627242:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081635.818285:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081635.818336:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081635.818374:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081635.818403:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796083072 00000100:00100000:3.0:1789081635.818414:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796083072 00000100:00100000:3.0:1789081635.818472:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796082944 00000100:00100000:3.0:1789081635.818486:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796082944 00000100:00100000:3.0:1789081635.818514:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 104 00000100:00100000:3.0:1789081635.818546:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03f7db20-3934-4266-b84f-346a4ea22636+5:2350:x1875987796083072:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081635.818624:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03f7db20-3934-4266-b84f-346a4ea22636+5:2350:x1875987796083072:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 102us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081635.818631:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 104 00000100:00100000:3.0:1789081635.818648:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 105 00000100:00100000:3.0:1789081635.818654:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+6:2350:x1875987796082944:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081635.818677:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+6:2350:x1875987796082944:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 23us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081635.818683:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 105 00000100:00080000:3.0:1789081635.818699:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789081635.819830:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796082816 00000100:00100000:0.0:1789081635.819842:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796082816 00000100:00100000:3.0:1789081635.820046:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 250 00000100:00100000:3.0:1789081635.820056:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ff8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2350:x1875987796082816:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081635.820119:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ff8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2350:x1875987796082816:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 64us (1847us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081635.820127:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 250 00010000:00010000:1.0:1789081636.637162:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081637.663280:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789081637.750242:0:11319:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 19:07:16 (1789081636) === 00000100:00100000:3.0:1789081638.046170:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081638.046373:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796083200 00000100:00100000:2.0:1789081638.046387:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796083200 00000100:00100000:2.0:1789081638.046487:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 14 00000100:00100000:2.0:1789081638.046500:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+6:2351:x1875987796083200:12345-192.168.201.17@tcp:41:mkdir.0 00000004:00000024:2.0:1789081638.046729:0:9245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:3.0:1789081638.048149:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789081638.048431:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081638.048697:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796083328 00000100:00100000:3.0:1789081638.048740:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796083328 00000100:00100000:3.0:1789081638.048821:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 0 00000100:00100000:3.0:1789081638.048833:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:41476931-e751-413e-b98c-64d4d0edcd05+7:9671:x1875987796083328:12345-192.168.201.17@tcp:700:mkdir.0 00000100:00100000:3.0:1789081638.048953:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:41476931-e751-413e-b98c-64d4d0edcd05+7:9671:x1875987796083328:12345-192.168.201.17@tcp:700:mkdir.0 Request processed in 123us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081638.048961:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 0 00000100:00100000:2.0:1789081638.050640:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+6:2351:x1875987796083200:12345-192.168.201.17@tcp:41:mkdir.0 Request processed in 4134us (4475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081638.050656:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 14 00000100:00100000:0.0:1789081638.065315:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081638.065494:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796083584 00000100:00100000:3.0:1789081638.065508:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796083584 00000100:00100000:3.0:1789081638.065642:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 15 00000100:00100000:3.0:1789081638.065653:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+6:9671:x1875987796083584:12345-192.168.201.17@tcp:36:mkdir.0 00010000:00010000:3.0:1789081638.065767:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081638.065920:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d5f719 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a785 expref: 6 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.065954:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c9a92000) 00010000:00010000:3.0:1789081638.065967:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789081638.066830:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5f838 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.066849:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5f838 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.066859:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5f838 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.066871:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999800/0xb7cb3d7479d5f83f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.066878:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999800/0xb7cb3d7479d5f83f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.066892:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999800/0xb7cb3d7479d5f83f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789081638.068780:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:3.0:1789081638.068798:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5f838 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.068808:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5f838 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.068815:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5f838 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.068821:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999400 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081638.068827:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5f838 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.068835:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5f838 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.068851:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10d046f500) 00010000:00010000:3.0:1789081638.068854:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081638.068859:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5f838 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.068865:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5f838 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789081638.068885:0:5789:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000da1f1ccc reply state 00000000d073c171 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999800/0xb7cb3d7479d5f83f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081638.068905:0:5789:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789081638.069033:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+7:9671:x1875987796083584:12345-192.168.201.17@tcp:36:mkdir.0 Request processed in 3377us (3731us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789081638.069042:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 15 00010000:00010000:1.0:1789081638.073484:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999800/0xb7cb3d7479d5f83f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.073502:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999800/0xb7cb3d7479d5f83f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.073510:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999800/0xb7cb3d7479d5f83f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.073551:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999800 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081638.073556:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999800/0xb7cb3d7479d5f83f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.073580:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999800/0xb7cb3d7479d5f83f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.073601:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e10d046f400) 00010000:00010000:1.0:1789081638.073603:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789081638.073608:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999800/0xb7cb3d7479d5f83f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.073614:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999800/0xb7cb3d7479d5f83f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081638.100397:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081638.100486:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796083712 00000100:00100000:1.0:1789081638.100496:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796083712 00000100:00100000:1.0:1789081638.100593:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 16 00000100:00100000:1.0:1789081638.100603:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+6:9672:x1875987796083712:12345-192.168.201.17@tcp:101:chmod.0 00010000:00010000:1.0:1789081638.100627:0:7252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081638.100650:0:7252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5f846 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a80a expref: -99 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.100728:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af200/0xb7cb3d7479d5f84d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.100742:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af200/0xb7cb3d7479d5f84d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.100753:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af200/0xb7cb3d7479d5f84d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789081638.100817:0:7252:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1789081638.100836:0:7252:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1789081638.100880:0:7252:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af200/0xb7cb3d7479d5f84d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.100907:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5f846 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a80a expref: 8 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.100925:0:7252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af200/0xb7cb3d7479d5f84d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a80a expref: 7 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.100935:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c7ecfa00) 00010000:00010000:1.0:1789081638.100938:0:7252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789081638.100941:0:7252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13af200, rc 0) 00000100:00100000:1.0:1789081638.101012:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+7:9672:x1875987796083712:12345-192.168.201.17@tcp:101:chmod.0 Request processed in 409us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081638.101021:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 16 00000100:00100000:3.0:1789081638.104845:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081638.104954:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796083968 00000100:00100000:2.0:1789081638.104966:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796083968 00000100:00100000:2.0:1789081638.105028:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 17 00000100:00100000:2.0:1789081638.105038:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+7:9672:x1875987796083968:12345-192.168.201.17@tcp:36:chmod.0 00010000:00010000:2.0:1789081638.105097:0:9245:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789081638.105141:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af200/0xb7cb3d7479d5f84d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a80a expref: 7 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081638.105177:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c7ecfa00) 00010000:00010000:2.0:1789081638.105189:0:9245:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789081638.105218:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d5f854 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081638.105231:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d5f854 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081638.105241:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d5f854 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789081638.105596:0:9245:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f9dd4c39 reply state 00000000eb929301 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d5f854 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081638.105605:0:9245:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789081638.105621:0:9245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1789081638.105696:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+8:9672:x1875987796083968:12345-192.168.201.17@tcp:36:chmod.0 Request processed in 659us (861us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789081638.105704:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 17 00010000:00010000:0.0:1789081638.111312:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d5f854 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.111330:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d5f854 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.111338:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d5f854 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.111344:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101774400 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081638.111368:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d5f854 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.111376:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d5f854 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.111396:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c9a92900) 00010000:00010000:0.0:1789081638.111400:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789081638.111404:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d5f854 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.111411:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d5f854 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081638.155622:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081638.156826:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796084096 00000100:00100000:0.0:1789081638.156838:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796084096 00000100:00100000:0.0:1789081638.156953:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 18 00000100:00100000:0.0:1789081638.156964:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+7:9673:x1875987796084096:12345-192.168.201.17@tcp:101:chown.0 00010000:00010000:0.0:1789081638.156988:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081638.157013:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c1486e00/0xb7cb3d7479d5f85b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a811 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.157080:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c1486400/0xb7cb3d7479d5f862 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.157095:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c1486400/0xb7cb3d7479d5f862 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.157125:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c1486400/0xb7cb3d7479d5f862 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789081638.157191:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1789081638.157212:0:5789:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1789081638.157257:0:5789:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c1486400/0xb7cb3d7479d5f862 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.157283:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c1486e00/0xb7cb3d7479d5f85b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a811 expref: 9 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.157303:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c1486400/0xb7cb3d7479d5f862 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a811 expref: 8 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.157312:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10d19d3700) 00010000:00010000:0.0:1789081638.157315:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789081638.157319:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10c1486400, rc 0) 00000100:00100000:0.0:1789081638.157733:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+8:9673:x1875987796084096:12345-192.168.201.17@tcp:101:chown.0 Request processed in 770us (2119us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081638.157741:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 18 00000100:00100000:2.0:1789081638.161222:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081638.161355:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796084224 00000100:00100000:0.0:1789081638.161364:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796084224 00000100:00100000:0.0:1789081638.161420:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 19 00000100:00100000:0.0:1789081638.161429:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+8:9673:x1875987796084224:12345-192.168.201.17@tcp:101:chown.0 00010000:00010000:0.0:1789081638.161458:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081638.161481:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c1487000/0xb7cb3d7479d5f869 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a818 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.161620:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c1487600/0xb7cb3d7479d5f870 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.161633:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c1487600/0xb7cb3d7479d5f870 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.161662:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c1487600/0xb7cb3d7479d5f870 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.161690:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5f877 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.161698:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5f877 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.161706:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5f877 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.162085:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5f87e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.162095:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5f87e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.162188:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5f87e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789081638.162231:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:0.0:1789081638.162235:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789081638.162261:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5f87e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.162273:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c1487600/0xb7cb3d7479d5f870 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.162280:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c1487600/0xb7cb3d7479d5f870 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.162299:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c1487600/0xb7cb3d7479d5f870 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.162306:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10c1487600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081638.162310:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c1487600/0xb7cb3d7479d5f870 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.162318:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c1487600/0xb7cb3d7479d5f870 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.162396:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10d19d3700) 00010000:00010000:0.0:1789081638.162400:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081638.162404:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c1487600/0xb7cb3d7479d5f870 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.162410:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c1487600/0xb7cb3d7479d5f870 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.162425:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5f877 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.162431:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5f877 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.162436:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5f877 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.162441:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101982e00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081638.162506:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5f877 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.162548:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5f877 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.162558:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e10d19d3400) 00010000:00010000:0.0:1789081638.162560:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081638.162563:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5f877 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.162569:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5f877 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.162602:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c1487000/0xb7cb3d7479d5f869 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a818 expref: 10 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.162617:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5f87e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a818 expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.162624:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e10d19d3600) 00010000:00010000:0.0:1789081638.162626:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789081638.162629:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101982000, rc 0) 00000100:00100000:0.0:1789081638.162876:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+9:9673:x1875987796084224:12345-192.168.201.17@tcp:101:chown.0 Request processed in 1446us (1660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081638.162884:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 19 00000100:00100000:3.0:1789081638.170371:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081638.171260:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796084480 00000100:00100000:2.0:1789081638.171272:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796084480 00000100:00100000:2.0:1789081638.171435:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 20 00000100:00100000:2.0:1789081638.171454:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+9:9673:x1875987796084480:12345-192.168.201.17@tcp:36:chown.0 00010000:00010000:2.0:1789081638.171540:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789081638.171569:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5f87e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a818 expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081638.171618:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e10d19d3600) 00010000:00010000:2.0:1789081638.171629:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789081638.171656:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d5f885 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081638.171669:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d5f885 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081638.171679:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d5f885 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789081638.246746:0:5811:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1789081638.246854:0:5790:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000064910a5d reply state 00000000a7730d2f transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d5f885 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081638.246872:0:5790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789081638.247094:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:2.0:1789081638.247431:0:5790:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1789081638.247462:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+7:9673:x1875987796084480:12345-192.168.201.17@tcp:36:chown.0 Request processed in 76011us (77095us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789081638.247473:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 20 00010000:00010000:0.0:1789081638.249774:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d5f885 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.249796:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d5f885 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.249818:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d5f885 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.249825:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101775000 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081638.249830:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d5f885 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.249840:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d5f885 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.249860:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e10c9a92a00) 00010000:00010000:0.0:1789081638.249864:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789081638.249869:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d5f885 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.249877:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d5f885 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081638.281799:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081638.284387:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796084608 00000100:00100000:0.0:1789081638.284409:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796084608 00000100:00100000:2.0:1789081638.294597:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 21 00000100:00100000:2.0:1789081638.294617:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+6:9674:x1875987796084608:12345-192.168.201.17@tcp:101:touch.500 00010000:00010000:2.0:1789081638.294654:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081638.294699:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774e00/0xb7cb3d7479d5f88c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a81f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789081638.297631:0:5789:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2850us 00010000:00010000:3.0:1789081638.331881:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5f893 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.331921:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5f893 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.331935:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5f893 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.331955:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5f89a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.331963:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5f89a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.331969:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5f89a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.332701:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999800/0xb7cb3d7479d5f8a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.332732:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999800/0xb7cb3d7479d5f8a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.332742:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999800/0xb7cb3d7479d5f8a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789081638.332825:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1789081638.332830:0:5789:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789081638.334067:0:5789:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999800/0xb7cb3d7479d5f8a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.334094:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5f893 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.334420:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5f893 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.334429:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5f893 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.334435:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999400 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081638.334440:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5f893 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.334448:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5f893 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.334467:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10d19d3700) 00010000:00010000:3.0:1789081638.334470:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081638.334475:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5f893 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.334497:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5f893 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.334660:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5f89a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.334668:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5f89a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.334674:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5f89a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.334680:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998800 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081638.334682:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5f89a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.334688:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5f89a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.334696:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e10d046f500) 00010000:00010000:3.0:1789081638.334699:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081638.334702:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5f89a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.334717:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5f89a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.334775:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774e00/0xb7cb3d7479d5f88c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a81f expref: 8 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.334793:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999800/0xb7cb3d7479d5f8a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a81f expref: 7 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.334809:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e10d046f300) 00010000:00010000:3.0:1789081638.334812:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789081638.334815:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101999800, rc 0) 00000100:00100000:3.0:1789081638.335245:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+7:9674:x1875987796084608:12345-192.168.201.17@tcp:101:touch.500 Request processed in 40504us (53332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081638.335258:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 21 00000100:00100000:2.0:1789081638.339238:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081638.339484:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796084864 00000100:00100000:0.0:1789081638.339499:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796084864 00000100:00100000:0.0:1789081638.339613:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 22 00000100:00100000:0.0:1789081638.339625:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+7:9674:x1875987796084864:12345-192.168.201.17@tcp:101:touch.500 00010000:00010000:0.0:1789081638.339658:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081638.339686:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982a00/0xb7cb3d7479d5f8a8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a826 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.340116:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5f8af lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.340142:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5f8af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.340157:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5f8af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.343074:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5f8b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.343108:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5f8b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.343122:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5f8b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789081638.344322:0:5791:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1789081638.344683:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5f8bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.344700:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5f8bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.344739:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5f8bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.344788:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5f8af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.344797:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5f8af lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.344805:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5f8af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.344812:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101983400 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081638.344817:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5f8af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.344826:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5f8af lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.344841:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e10d046f300) 00010000:00010000:1.0:1789081638.344844:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789081638.344849:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5f8af lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.344856:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5f8af lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789081638.344872:0:5791:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d2e1c3b0 reply state 000000003437ff94 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5f8b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081638.344884:0:5791:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789081638.344941:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982a00/0xb7cb3d7479d5f8a8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a826 expref: 10 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.344958:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5f8bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a826 expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.344966:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e10c7ecf100) 00010000:00010000:1.0:1789081638.344969:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789081638.344971:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13af400, rc 0) 00000100:00100000:1.0:1789081638.345084:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+10:9674:x1875987796084864:12345-192.168.201.17@tcp:101:touch.500 Request processed in 5459us (5860us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789081638.345094:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 22 00010000:00010000:0.0:1789081638.347514:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5f8b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.347593:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5f8b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.347602:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5f8b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.347608:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13afe00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081638.347613:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5f8b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.347622:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5f8b6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.347641:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x9a0eeda8 (ffff9e10c7ecf700) 00010000:00010000:0.0:1789081638.347644:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081638.347649:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5f8b6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.347654:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5f8b6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081638.349161:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081638.349398:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796085120 00000100:00100000:3.0:1789081638.349413:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796085120 00000100:00100000:3.0:1789081638.349493:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 23 00000100:00100000:3.0:1789081638.349506:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+9:9674:x1875987796085120:12345-192.168.201.17@tcp:36:touch.500 00010000:00010000:3.0:1789081638.349793:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081638.349828:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5f8bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a826 expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.349849:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e10c7ecf100) 00010000:00010000:3.0:1789081638.349862:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789081638.351435:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5f8cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.351457:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5f8cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.351467:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5f8cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789081638.352264:0:5790:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aaca6abf reply state 00000000a884309b transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5f8cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081638.352307:0:5790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789081638.352513:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+10:9674:x1875987796085120:12345-192.168.201.17@tcp:36:touch.500 Request processed in 3004us (3357us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789081638.352554:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 23 00000100:00100000:1.0:1789081638.355946:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081638.356296:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796085248 00000100:00100000:3.0:1789081638.356311:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796085248 00000100:00100000:3.0:1789081638.356391:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 24 00000100:00100000:3.0:1789081638.356403:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+10:9674:x1875987796085248:12345-192.168.201.17@tcp:101:touch.500 00010000:00010000:3.0:1789081638.356437:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081638.356468:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5f8d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a82d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.356607:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5f8d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a82d expref: 11 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.356626:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5f8d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a82d expref: 11 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.356651:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e10d046f500) 00010000:00010000:3.0:1789081638.356655:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789081638.356660:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101999400, rc 0) 00000100:00100000:3.0:1789081638.356746:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+11:9674:x1875987796085248:12345-192.168.201.17@tcp:101:touch.500 Request processed in 346us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081638.356753:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 24 00010000:00010000:0.0:1789081638.357809:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5f8cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.357842:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5f8cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.357849:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5f8cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.357856:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998800 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081638.357862:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5f8cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.357871:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5f8cb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.357890:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e10d046f500) 00010000:00010000:0.0:1789081638.357893:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081638.357899:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5f8cb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.357904:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5f8cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081638.364678:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081638.364807:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796085376 00000100:00100000:3.0:1789081638.364822:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796085376 00000100:00100000:3.0:1789081638.364963:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 16 00000100:00100000:3.0:1789081638.364973:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2347:x1875987796085376:12345-192.168.201.17@tcp:8:touch.500 00010000:00080000:3.0:1789081638.365047:0:6584:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 41476931-e751-413e-b98c-64d4d0edcd05@192.168.201.17@tcp t0 exp 0000000000000000 cur 305 last 0 00000020:00000080:3.0:1789081638.365091:0:6584:0:(genops.c:1406:class_connect()) connect: client 41476931-e751-413e-b98c-64d4d0edcd05, cookie 0xb7cb3d7479d5f8d9 00002000:00100000:3.0:1789081638.365119:0:6584:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 41476931-e751-413e-b98c-64d4d0edcd05/ffff9e10f97eb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113719 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789081638.365149:0:6584:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789081638.365875:0:6584:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789081638.365922:0:6584:0:(import.c:65:import_set_state_nolock()) ffff9e10f97ed000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789081638.366028:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+6:2347:x1875987796085376:12345-192.168.201.17@tcp:8:touch.500 Request processed in 1053us (1528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081638.366040:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 16 00000100:00100000:3.0:1789081638.381792:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081638.382162:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796085504 00000100:00100000:1.0:1789081638.382177:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796085504 00000100:00100000:1.0:1789081638.382441:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 17 00000100:00100000:1.0:1789081638.382453:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41476931-e751-413e-b98c-64d4d0edcd05+6:0:x1875987796085504:12345-192.168.201.17@tcp:2:touch.500 00000100:00080000:3.0:1789081638.387444:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1789081638.425872:0:7493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:0.0:1789081638.425901:0:7493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 41476931-e751-413e-b98c-64d4d0edcd05 00000100:00100000:2.0:1789081638.426447:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41476931-e751-413e-b98c-64d4d0edcd05+5:0:x1875987796085504:12345-192.168.201.17@tcp:2:touch.500 Request processed in 43986us (44660us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789081638.426462:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 17 00000100:00100000:1.0:1789081638.433978:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081638.434193:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796085760 00000100:00100000:0.0:1789081638.434282:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796085760 00000100:00100000:0.0:1789081638.434369:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 2 00000100:00100000:0.0:1789081638.434381:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+10:9674:x1875987796085760:12345-192.168.201.17@tcp:35:touch.500 00000100:00100000:0.0:1789081638.434947:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+11:9674:x1875987796085760:12345-192.168.201.17@tcp:35:touch.500 Request processed in 565us (981us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789081638.434976:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 2 00000100:00100000:1.0:1789081638.448487:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081638.448848:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796085888 00000100:00100000:3.0:1789081638.448862:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796085888 00000100:00100000:3.0:1789081638.448941:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 25 00000100:00100000:3.0:1789081638.448952:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+11:9675:x1875987796085888:12345-192.168.201.17@tcp:101:rm.0 00010000:00010000:3.0:1789081638.448985:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081638.449013:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5f8e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a834 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.449120:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5f8e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.449139:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5f8e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.449152:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5f8e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789081638.449266:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1789081638.449271:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789081638.449334:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5f8e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.449367:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5f8e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a834 expref: 13 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.449390:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5f8e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a834 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.449401:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e10d046f300) 00010000:00010000:3.0:1789081638.449404:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789081638.449408:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101999000, rc 0) 00000100:00100000:3.0:1789081638.449489:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+12:9675:x1875987796085888:12345-192.168.201.17@tcp:101:rm.0 Request processed in 538us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081638.449498:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 25 00000100:00100000:2.0:1789081638.455216:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081638.455370:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796086144 00000100:00100000:3.0:1789081638.455385:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796086144 00000100:00100000:3.0:1789081638.455464:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 26 00000100:00100000:3.0:1789081638.455477:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+12:9675:x1875987796086144:12345-192.168.201.17@tcp:101:rm.0 00010000:00010000:3.0:1789081638.455516:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081638.455598:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5f8ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a83b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789081638.455783:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1789081638.456002:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5f8ee lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a83b expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.456039:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10d19d3700) 00010000:00010000:3.0:1789081638.456042:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789081638.456049:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5f8ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a83b expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.456063:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101998e00, rc 0) 00000100:00100000:3.0:1789081638.456455:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+13:9675:x1875987796086144:12345-192.168.201.17@tcp:101:rm.0 Request processed in 979us (1261us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1789081638.456465:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 26 00000100:00100000:1.0:1789081638.464106:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081638.464304:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796086272 00000100:00100000:3.0:1789081638.464320:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796086272 00000100:00100000:3.0:1789081638.464406:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 3 00000100:00100000:3.0:1789081638.464418:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+13:9675:x1875987796086272:12345-192.168.201.17@tcp:37:rm.0 00000100:00100000:2.0:1789081638.472717:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+13:9675:x1875987796086272:12345-192.168.201.17@tcp:37:rm.0 Request processed in 8274us (8608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081638.472743:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 3 00000100:00100000:2.0:1789081638.477428:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081638.477644:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796086528 00000100:00100000:0.0:1789081638.477659:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796086528 00000100:00100000:0.0:1789081638.477773:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 4 00000100:00100000:0.0:1789081638.477785:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b66450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+13:9675:x1875987796086528:12345-192.168.201.17@tcp:35:rm.0 00000100:00100000:0.0:1789081638.478228:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b66450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+14:9675:x1875987796086528:12345-192.168.201.17@tcp:35:rm.0 Request processed in 443us (812us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789081638.478237:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 4 00000100:00100000:1.0:1789081638.481607:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081638.481913:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796086784 00000100:00100000:3.0:1789081638.481928:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796086784 00000100:00100000:3.0:1789081638.482003:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 27 00000100:00100000:3.0:1789081638.482185:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+14:9675:x1875987796086784:12345-192.168.201.17@tcp:101:rm.0 00010000:00010000:3.0:1789081638.482234:0:7252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081638.482262:0:7252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5f8fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a842 expref: -99 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.482439:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d5f903 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.482456:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d5f903 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.482492:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d5f903 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789081638.482507:0:7252:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1789081638.482787:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5f8fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a842 expref: 17 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.482812:0:7252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d5f903 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a842 expref: 16 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.482821:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e10d046f300) 00010000:00010000:3.0:1789081638.482825:0:7252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789081638.482829:0:7252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101998200, rc 0) 00000100:00100000:3.0:1789081638.482900:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+16:9675:x1875987796086784:12345-192.168.201.17@tcp:101:rm.0 Request processed in 720us (1308us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789081638.486306:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 27 00000100:00100000:1.0:1789081638.486692:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081638.486854:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796086912 00000100:00100000:0.0:1789081638.486867:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796086912 00000100:00100000:2.0:1789081638.486942:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 28 00000100:00100000:2.0:1789081638.486956:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+16:9675:x1875987796086912:12345-192.168.201.17@tcp:41:rm.0 00000004:00000024:2.0:1789081638.487048:0:9245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1789081638.487181:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+16:9675:x1875987796086912:12345-192.168.201.17@tcp:41:rm.0 Request processed in 228us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081638.487190:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 28 00000100:00100000:2.0:1789081638.490321:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081638.490482:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796087040 00000100:00100000:3.0:1789081638.490495:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796087040 00000100:00100000:3.0:1789081638.490605:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 29 00000100:00100000:3.0:1789081638.490616:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+16:9675:x1875987796087040:12345-192.168.201.17@tcp:101:rm.0 00010000:00010000:3.0:1789081638.490644:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081638.490673:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999c00/0xb7cb3d7479d5f911 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a849 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.490769:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5f918 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.490809:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5f918 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.490824:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5f918 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.490841:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d5f91f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.490849:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d5f91f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.490855:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d5f91f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.491008:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d5f926 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.491015:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d5f926 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.491021:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d5f926 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789081638.491056:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789081638.491060:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789081638.491083:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d5f926 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.491174:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d5f926 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.491264:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5f918 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.491273:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5f918 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.491281:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5f918 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.491288:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999e00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081638.491294:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5f918 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.491303:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5f918 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.491318:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e10d046f300) 00010000:00010000:3.0:1789081638.491389:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081638.491398:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5f918 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.491405:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5f918 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.491424:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d5f91f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.491430:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d5f91f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.491436:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d5f91f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.491448:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081638.491451:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d5f91f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.491458:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d5f91f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.491466:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x9a0eeda8 (ffff9e10d046fa00) 00010000:00010000:3.0:1789081638.491469:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081638.491471:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d5f91f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.491478:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d5f91f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.491515:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999c00/0xb7cb3d7479d5f911 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a849 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.491570:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d5f926 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a849 expref: 17 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.491579:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e10d046f500) 00010000:00010000:3.0:1789081638.491581:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789081638.491584:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101998600, rc 0) 00000100:00100000:3.0:1789081638.491683:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+17:9675:x1875987796087040:12345-192.168.201.17@tcp:101:rm.0 Request processed in 1067us (1376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081638.491693:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 29 00000100:00100000:1.0:1789081638.495828:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081638.495960:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796087296 00000100:00100000:2.0:1789081638.495975:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796087296 00000100:00100000:0.0:1789081638.496211:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 30 00000100:00100000:0.0:1789081638.496377:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+17:9675:x1875987796087296:12345-192.168.201.17@tcp:36:rm.0 00010000:00010000:0.0:1789081638.496452:0:7252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789081638.496491:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d5f926 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a849 expref: 17 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.496671:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5f8d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a82d expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.496689:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e10d046f500) 00010000:00010000:0.0:1789081638.496719:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5f8e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a834 expref: 15 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.496730:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e10d046f300) 00010000:00010000:0.0:1789081638.496733:0:7252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789081638.496776:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982800/0xb7cb3d7479d5f92d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.496792:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982800/0xb7cb3d7479d5f92d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.496805:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982800/0xb7cb3d7479d5f92d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.496821:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5f934 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.496827:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5f934 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.496834:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5f934 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.496992:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5f93b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.497002:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5f93b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.497088:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5f93b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789081638.505980:0:7252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1789081638.506024:0:7252:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 305388498795ns, next at 306388492812ns, rc = 0 00010000:00010000:1.0:1789081638.506164:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5f942 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.506337:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5f942 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.506355:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5f942 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.506366:0:7252:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5f942 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.506373:0:7252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5f942 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.506381:0:7252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5f942 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.506412:0:7252:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789081638.506446:0:7252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5f93b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.506453:0:7252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5f93b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.506459:0:7252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5f93b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.506466:0:7252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101982600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081638.506471:0:7252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5f93b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.506479:0:7252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5f93b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.506503:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e10d19d3400) 00010000:00010000:1.0:1789081638.506506:0:7252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789081638.506512:0:7252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5f93b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.506519:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5f93b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.506576:0:7252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982800/0xb7cb3d7479d5f92d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.506583:0:7252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982800/0xb7cb3d7479d5f92d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.506589:0:7252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982800/0xb7cb3d7479d5f92d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.506595:0:7252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101982800 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081638.506598:0:7252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982800/0xb7cb3d7479d5f92d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.506604:0:7252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982800/0xb7cb3d7479d5f92d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.506613:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e10d046f300) 00010000:00010000:1.0:1789081638.506615:0:7252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789081638.506619:0:7252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982800/0xb7cb3d7479d5f92d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081638.506625:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982800/0xb7cb3d7479d5f92d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789081638.506647:0:7252:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000107d7f82 reply state 0000000027242de2 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5f934 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081638.506659:0:7252:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789081638.506787:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+16:9675:x1875987796087296:12345-192.168.201.17@tcp:36:rm.0 Request processed in 10560us (10968us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789081638.506798:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 30 00010000:00010000:3.0:1789081638.507650:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789081638.507673:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5f942 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.507681:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13aee00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:3.0:1789081638.507685:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5f942 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.507694:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5f942 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.507718:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e10d19d3400) 00010000:00010000:3.0:1789081638.507721:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789081638.507725:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5f942 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.507730:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5f942 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.507753:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081638.507755:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081638.507757:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789081638.510800:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081638.510886:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796087552 00000100:00100000:3.0:1789081638.510899:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796087552 00000100:00100000:3.0:1789081638.510964:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 5 00000100:00100000:3.0:1789081638.510975:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+16:9675:x1875987796087552:12345-192.168.201.17@tcp:35:rm.0 00000100:00100000:3.0:1789081638.511363:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+17:9675:x1875987796087552:12345-192.168.201.17@tcp:35:rm.0 Request processed in 389us (576us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789081638.511373:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 5 00010000:00010000:0.0:1789081638.511994:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5f934 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.512019:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5f934 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.512028:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5f934 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.512053:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101982200 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081638.512059:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5f934 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.512067:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5f934 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.512087:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x9a0eeda8 (ffff9e10d19d3000) 00010000:00010000:0.0:1789081638.512090:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081638.512096:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5f934 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.512102:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5f934 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081638.519394:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081638.519501:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796087808 00000100:00100000:3.0:1789081638.519515:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796087808 00000100:00100000:3.0:1789081638.519622:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 31 00000100:00100000:3.0:1789081638.519649:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+16:9675:x1875987796087808:12345-192.168.201.17@tcp:36:rm.0 00010000:00010000:3.0:1789081638.519911:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789081638.519949:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d5f903 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a842 expref: 16 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.519976:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999800/0xb7cb3d7479d5f8a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a81f expref: 15 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.519988:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e10d046f300) 00010000:00010000:3.0:1789081638.520006:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c1486400/0xb7cb3d7479d5f862 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a811 expref: 14 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.520016:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10d19d3700) 00010000:00010000:3.0:1789081638.520023:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789081638.520051:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999c00/0xb7cb3d7479d5f949 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.520066:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999c00/0xb7cb3d7479d5f949 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.520077:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999c00/0xb7cb3d7479d5f949 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.520089:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d5f950 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.520372:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d5f950 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.520382:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d5f950 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.520823:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5f957 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.520833:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5f957 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.520840:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5f957 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789081638.521589:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1789081638.521610:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5f957 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.521619:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5f957 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.521627:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5f957 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.521633:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999e00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081638.521639:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5f957 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.521647:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5f957 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.521659:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e10d046f200) 00010000:00010000:3.0:1789081638.521662:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789081638.521666:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5f957 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.521683:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5f957 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.521719:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999c00/0xb7cb3d7479d5f949 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.521725:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999c00/0xb7cb3d7479d5f949 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.521731:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999c00/0xb7cb3d7479d5f949 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.521736:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999c00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081638.521739:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999c00/0xb7cb3d7479d5f949 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.521745:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999c00/0xb7cb3d7479d5f949 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.521752:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10d046fa00) 00010000:00010000:3.0:1789081638.521754:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081638.521757:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999c00/0xb7cb3d7479d5f949 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081638.521762:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999c00/0xb7cb3d7479d5f949 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789081638.521772:0:5789:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000095809a02 reply state 0000000071b5553c transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d5f950 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081638.521781:0:5789:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789081638.521905:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+15:9675:x1875987796087808:12345-192.168.201.17@tcp:36:rm.0 Request processed in 2253us (2522us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789081638.521913:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 31 00010000:00010000:0.0:1789081638.529761:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d5f950 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.529785:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d5f950 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.529795:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d5f950 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.529803:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081638.529808:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d5f950 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.529817:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d5f950 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.529866:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e10d046ff00) 00010000:00010000:0.0:1789081638.529869:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081638.529875:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d5f950 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.529883:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d5f950 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081638.684842:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081639.712714:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081639.773162:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d0ef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821284736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789081639.773236:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081639.773304:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821284736 00000100:00100000:1.0:1789081639.773747:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821284736 00000100:00100000:1.0:1789081639.773852:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789081639.773862:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821284736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789081639.773900:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789081639.773952:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821284736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081639.773959:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1789081639.774005:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789081639.774149:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10d0ef3480 x1875987821284736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081655 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789081639.774170:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d0ef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821284736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789081640.297952:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821284864:0@lo:400:kworker.0 00000100:00100000:2.0:1789081640.298000:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875987821285120:0@lo:400:kworker.0 00000100:00100000:3.0:1789081640.298070:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081640.298090:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081640.298141:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821285248:0@lo:400:kworker.0 00000100:00100000:3.0:1789081640.298170:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875987821285376:0@lo:400:kworker.0 00000100:00100000:2.0:1789081640.298218:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789081640.298228:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081640.298231:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875987821284992:0@lo:400:kworker.0 00000100:00100000:2.0:1789081640.298273:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081640.298301:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821285504:0@lo:400:kworker.0 00000100:00100000:3.0:1789081640.298318:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821284864 00000100:00100000:2.0:1789081640.298328:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081640.298330:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821284864 00000100:00100000:2.0:1789081640.298380:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821285504 00000100:00100000:2.0:1789081640.298388:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821285504 00000100:00100000:3.0:1789081640.298412:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1789081640.298430:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ff9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3306:x1875987821284864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789081640.298453:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789081640.298464:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2ded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821285504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081640.298512:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ff9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3306:x1875987821284864:12345-0@lo:400:kworker.0 Request processed in 85us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081640.298554:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1789081640.298589:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2ded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821285504:12345-0@lo:400:kworker.0 Request processed in 125us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081640.298599:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789081640.298617:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821285120 00000100:00100000:3.0:1789081640.298624:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821285120 00010000:00080000:2.0:1789081640.298653:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10d2defb80 x1875987821285504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789081656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789081640.298668:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821285376 00000100:00100000:2.0:1789081640.298669:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821285504:0@lo:400:kworker.0 00000100:00100000:3.0:1789081640.298689:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821285376 00000100:00100000:3.0:1789081640.298721:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821284992 00000100:00100000:3.0:1789081640.298725:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821284992 00000100:00100000:2.0:1789081640.298736:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789081640.298752:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875987821285120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081640.298758:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789081640.298771:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff703b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875987821285376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789081640.298814:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875987821285120:12345-0@lo:400:kworker.0 Request processed in 65us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081640.298827:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789081640.298835:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff703b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875987821285376:12345-0@lo:400:kworker.0 Request processed in 65us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081640.298857:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789081640.298870:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789081640.298879:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875987821284992:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789081640.298913:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789081640.298921:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789081640.298936:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875987821284992:12345-0@lo:400:kworker.0 Request processed in 64us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081640.298948:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789081640.298971:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875987821285376:0@lo:400:kworker.0 00000100:00100000:3.0:1789081640.298996:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821284864:0@lo:400:kworker.0 00000100:00100000:2.0:1789081640.299005:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875987821284992:0@lo:400:kworker.0 00000100:00100000:2.0:1789081640.299027:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875987821285120:0@lo:400:kworker.0 00000004:00080000:2.0:1789081640.303856:0:7779:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 307186329462ns, next at 308186326730ns, rc = 0 00000100:00100000:3.0:1789081640.303980:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789081640.304015:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821285632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789081640.304115:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081640.304188:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821285632 00000100:00100000:2.0:1789081640.304206:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821285632 00000100:00100000:2.0:1789081640.304269:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789081640.304279:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff701c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821285632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789081640.304315:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789081640.304388:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff701c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821285632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081640.304395:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1789081640.304417:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10d2defb80 x1875987821285632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081656 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789081640.304449:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821285632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789081640.304459:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081640.304743:0:7788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821285248 00000100:00100000:2.0:1789081640.304749:0:7788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821285248 00000100:00100000:2.0:1789081640.304784:0:7788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789081640.304791:0:7788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5e5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821285248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789081640.305720:0:7788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5e5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821285248:12345-0@lo:400:kworker.0 Request processed in 925us (1259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081640.305731:0:7788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1789081640.308711:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10d2dc3100 x1875987821285248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789081656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789081640.308732:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821285248:0@lo:400:kworker.0 00010000:00010000:1.0:1789081640.741495:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081640.921849:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081640.922480:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081640.922513:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081640.922560:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081640.922594:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796088192 00000100:00100000:3.0:1789081640.922610:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796088192 00000100:00100000:3.0:1789081640.922898:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 37 00000100:00100000:3.0:1789081640.922910:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff702a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41476931-e751-413e-b98c-64d4d0edcd05+5:2349:x1875987796088192:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081640.922989:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff702a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41476931-e751-413e-b98c-64d4d0edcd05+5:2349:x1875987796088192:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 80us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081640.922996:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 37 00000100:00100000:3.0:1789081640.923021:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796088064 00000100:00100000:3.0:1789081640.923025:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796088064 00000100:00100000:3.0:1789081640.923055:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796088320 00000100:00100000:3.0:1789081640.923069:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796088320 00000100:00100000:3.0:1789081640.923097:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 109 00000100:00100000:3.0:1789081640.923103:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff702d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+14:2349:x1875987796088064:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081640.923134:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff702d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+14:2349:x1875987796088064:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 31us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081640.923141:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 109 00000100:00100000:3.0:1789081640.923152:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 110 00000100:00100000:3.0:1789081640.923158:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff703480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03f7db20-3934-4266-b84f-346a4ea22636+5:2349:x1875987796088320:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081640.923182:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff703480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03f7db20-3934-4266-b84f-346a4ea22636+5:2349:x1875987796088320:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 24us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081640.923187:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 110 00000100:00080000:3.0:1789081640.923209:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789081640.923214:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789081640.924680:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796087936 00000100:00100000:1.0:1789081640.924692:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796087936 00000100:00100000:1.0:1789081640.924741:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 252 00000100:00100000:1.0:1789081640.924750:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ffac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2349:x1875987796087936:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:1.0:1789081640.924812:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ffac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2349:x1875987796087936:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 63us (2974us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081640.924820:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 252 00010000:00010000:1.0:1789081641.757739:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789081642.502865:0:11467:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1789081642.781986:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789081643.454870:0:5811:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:1.0:1789081643.454890:0:5811:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000004:00080000:1.0:1789081643.454938:0:5811:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:1.0:1789081643.454949:0:5811:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:1.0:1789081643.455126:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821285760:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789081643.455215:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081643.455727:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821285760 00000100:00100000:2.0:1789081643.455737:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821285760 00000100:00100000:2.0:1789081643.455800:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789081643.455809:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821285760:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789081643.455842:0:6581:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1789081643.455886:0:6581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa33826, atime: 0x6aa33826, ctime: 0x6aa33826, blocks: 0x1 00010000:00010000:2.0:1789081643.455894:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000784b0e4c/0xb7cb3d7479d5f95e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081643.455913:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=310s v=(0 0) 00010000:00010000:2.0:1789081643.455917:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789081643.455924:0:6581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000784b0e4c/0xb7cb3d7479d5f95e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081643.455951:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000784b0e4c/0xb7cb3d7479d5f95e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081643.455960:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000784b0e4c/0xb7cb3d7479d5f95e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081643.455965:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000784b0e4c/0xb7cb3d7479d5f95e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081643.455985:0:6581:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789081643.456021:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789081643.456033:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000784b0e4c/0xb7cb3d7479d5f95e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081643.456047:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101775a00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:1.0:1789081643.456053:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000784b0e4c/0xb7cb3d7479d5f95e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081643.456066:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000784b0e4c/0xb7cb3d7479d5f95e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081643.456095:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000784b0e4c/0xb7cb3d7479d5f95e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081643.456111:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000784b0e4c/0xb7cb3d7479d5f95e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081643.456149:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081643.456152:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081643.456154:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789081643.456668:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875987821285760:12345-0@lo:6:osp-syn-1-0.0 Request processed in 859us (1453us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789081643.456676:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1789081643.456720:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789081643.456739:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e10d2ded500/2, rc 0, transno 4294967300 00000100:00100000:1.0:1789081643.456750:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821285760:0@lo:6:osp-syn-1-0.0 00000020:00000080:3.0:1789081643.598826:0:11518:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcd2de0da0 20000000:00000080:3.0:1789081643.598858:0:11518:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e10ff65b000 uarg=0000000000000000 20000000:01000000:3.0:1789081643.598926:0:11518:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1789081643.598936:0:11518:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1789081643.599388:0:11518:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1789081643.600733:0:11519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1789081643.601004:0:11518:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1789081643.615222:0:11518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1789081643.615379:0:11518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1789081643.615480:0:11518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1789081643.615514:0:11518:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789081643.619751:0:11518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e1101983c00/0xb7cb3d7479d5f965 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081643.619788:0:11518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e10c29e0400/0xb7cb3d7479d5f807 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f800 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081643.619797:0:11518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e10c29e0600/0xb7cb3d7479d5f815 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f80e expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081643.619804:0:11518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e1101998a00/0xb7cb3d7479d5f823 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f81c expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081643.619816:0:11518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e1101998000/0xb7cb3d7479d5f82a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a7fc expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081643.619824:0:11518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e10c1487e00/0xb7cb3d7479d5f831 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a803 expref: 12 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081643.619854:0:11518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e1101983c00/0xb7cb3d7479d5f965 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081643.619913:0:11518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e10c1487e00/0xb7cb3d7479d5f831 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a803 expref: 12 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081643.619934:0:11518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e10c1487e00/0xb7cb3d7479d5f831 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a803 expref: 12 pid: 5782 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081643.619954:0:11518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d0ef3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11518:1875987821285888:192.168.201.17@tcp:104: 00010000:00010000:0.0:1789081643.620121:0:11518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e1101998000/0xb7cb3d7479d5f82a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a7fc expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081643.620132:0:11518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e1101998000/0xb7cb3d7479d5f82a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a7fc expref: 12 pid: 5783 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081643.620141:0:11518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d0ef0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11518:1875987821286016:192.168.201.17@tcp:104: 00010000:00010000:0.0:1789081643.620187:0:11518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e1101998a00/0xb7cb3d7479d5f823 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb7cb3d7479d5f81c expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081643.620197:0:11518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e1101998a00/0xb7cb3d7479d5f823 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f81c expref: 18 pid: 5783 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081643.620208:0:11518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d0ef0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11518:1875987821286144:0@lo:104: 00000100:00100000:0.0:1789081643.620263:0:11518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789081643.620309:0:11518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e10c29e0600/0xb7cb3d7479d5f815 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb7cb3d7479d5f80e expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081643.620331:0:11518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e10c29e0600/0xb7cb3d7479d5f815 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f80e expref: 18 pid: 5783 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081643.620340:0:11518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11518:1875987821286272:0@lo:104: 00000100:00100000:0.0:1789081643.620373:0:11518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789081643.620407:0:11518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e10c29e0400/0xb7cb3d7479d5f807 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb7cb3d7479d5f800 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081643.620415:0:11518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e10c29e0400/0xb7cb3d7479d5f807 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f800 expref: 18 pid: 5783 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081643.620423:0:11518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11518:1875987821286400:0@lo:104: 00000100:00100000:0.0:1789081643.620442:0:11518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c539f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789081643.621041:0:5773:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789081643.621067:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081643.621084:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821286144 00000100:00100000:1.0:1789081643.621092:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821286144 00000100:00100000:1.0:1789081643.621145:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821286272 00000100:00100000:1.0:1789081643.621148:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821286272 00000100:00100000:1.0:1789081643.621159:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821286400 00000100:00100000:1.0:1789081643.621162:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821286400 00000100:00100000:1.0:1789081643.621177:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789081643.621186:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+5:11518:x1875987821286144:12345-0@lo:104: 00010000:00010000:1.0:1789081643.621203:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.117@tcp lock: ffff9e1101775600/0xb7cb3d7479d5f81c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f823 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081643.621304:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789081643.621311:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+5:11518:x1875987821286144:12345-0@lo:104: Request processed in 126us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081643.621319:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789081643.621343:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789081643.621349:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f01050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+4:11518:x1875987821286272:12345-0@lo:104: 00010000:00010000:1.0:1789081643.621369:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1c00/0xb7cb3d7479d5f80e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f815 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081643.621405:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789081643.621411:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f01050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+4:11518:x1875987821286272:12345-0@lo:104: Request processed in 63us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081643.621417:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789081643.621455:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789081643.621461:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+3:11518:x1875987821286400:12345-0@lo:104: 00010000:00010000:1.0:1789081643.621469:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0000/0xb7cb3d7479d5f800 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f807 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081643.621496:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789081643.621500:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+3:11518:x1875987821286400:12345-0@lo:104: Request processed in 40us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081643.621507:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:1.0:1789081643.621562:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789081643.621569:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e1101775600/0xb7cb3d7479d5f81c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f823 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081643.621577:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101775600 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:1.0:1789081643.621582:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e1101775600/0xb7cb3d7479d5f81c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb7cb3d7479d5f823 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081643.621592:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e1101775600/0xb7cb3d7479d5f81c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb7cb3d7479d5f823 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789081643.621599:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e1101775600/0xb7cb3d7479d5f81c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb7cb3d7479d5f823 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789081643.621612:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789081643.621663:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e1101775600/0xb7cb3d7479d5f81c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f823 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081643.621671:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789081643.621699:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e1101775600/0xb7cb3d7479d5f81c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f823 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081643.621708:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e1101775600/0xb7cb3d7479d5f81c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f823 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081643.621726:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789081643.621730:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1c00/0xb7cb3d7479d5f80e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f815 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081643.621737:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10c29e1c00 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:1.0:1789081643.621740:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1c00/0xb7cb3d7479d5f80e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb7cb3d7479d5f815 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081643.621748:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1c00/0xb7cb3d7479d5f80e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb7cb3d7479d5f815 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789081643.621755:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1c00/0xb7cb3d7479d5f80e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb7cb3d7479d5f815 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789081643.621762:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789081643.621781:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1c00/0xb7cb3d7479d5f80e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f815 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081643.621787:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789081643.621819:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1c00/0xb7cb3d7479d5f80e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f815 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081643.621826:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1c00/0xb7cb3d7479d5f80e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f815 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081643.621837:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789081643.621840:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0000/0xb7cb3d7479d5f800 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d5f807 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081643.621848:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10c29e0000 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:1.0:1789081643.621852:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0000/0xb7cb3d7479d5f800 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb7cb3d7479d5f807 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081643.621860:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0000/0xb7cb3d7479d5f800 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb7cb3d7479d5f807 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789081643.621868:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0000/0xb7cb3d7479d5f800 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb7cb3d7479d5f807 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789081643.621873:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789081643.621896:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0000/0xb7cb3d7479d5f800 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f807 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081643.621902:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789081643.621908:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0000/0xb7cb3d7479d5f800 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f807 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081643.621914:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e10c29e0000/0xb7cb3d7479d5f800 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d5f807 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081643.621929:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081643.621936:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081643.621938:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081643.621948:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789081643.621965:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5f06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821286528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789081643.622007:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081643.622073:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5f05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee551687-7675-4fc6-9be1-2ccb62bdd809:3303:1875987821286656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789081643.622100:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081643.622127:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789081643.622133:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5f06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee551687-7675-4fc6-9be1-2ccb62bdd809:3303:1875987821286784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789081643.622160:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821286528 00000100:00100000:1.0:1789081643.622165:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081643.622178:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821286528 00000100:00100000:1.0:1789081643.622202:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821286656 00000100:00100000:1.0:1789081643.622209:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821286656 00010000:00010000:3.0:1789081643.622227:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e1101998a00/0xb7cb3d7479d5f823 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f81c expref: 20 pid: 5783 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081643.622234:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e10c29e0600/0xb7cb3d7479d5f815 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f80e expref: 20 pid: 5783 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081643.622262:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821286784 00000100:00100000:1.0:1789081643.622264:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821286784 00010000:00010000:1.0:1789081643.622276:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e10c29e0400/0xb7cb3d7479d5f807 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f800 expref: 21 pid: 5783 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081643.622289:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789081643.622296:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee551687-7675-4fc6-9be1-2ccb62bdd809+21:3303:x1875987821286656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789081643.622308:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789081643.622314:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e10c29e0600/0xb7cb3d7479d5f815 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f80e expref: 21 pid: 5783 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081643.622325:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e10c29e0600/0xb7cb3d7479d5f815 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f80e expref: 21 pid: 5783 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081643.622358:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789081643.622393:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee551687-7675-4fc6-9be1-2ccb62bdd809+21:3303:x1875987821286656:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081643.622400:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789081643.622418:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789081643.622423:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c938b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee551687-7675-4fc6-9be1-2ccb62bdd809+20:3303:x1875987821286784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789081643.622431:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789081643.622435:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e10c29e0400/0xb7cb3d7479d5f807 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f800 expref: 20 pid: 5783 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081643.622443:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e10c29e0400/0xb7cb3d7479d5f807 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f800 expref: 20 pid: 5783 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081643.622452:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789081643.622471:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c938b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee551687-7675-4fc6-9be1-2ccb62bdd809+20:3303:x1875987821286784:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081643.622477:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789081643.622556:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5f06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee551687-7675-4fc6-9be1-2ccb62bdd809:3303:1875987821286784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789081643.622573:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5f05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee551687-7675-4fc6-9be1-2ccb62bdd809:3303:1875987821286656:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789081643.622653:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789081643.622666:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3306:x1875987821286528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789081643.622683:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081643.622708:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e1101998a00/0xb7cb3d7479d5f823 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f81c expref: 19 pid: 5783 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081643.622722:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e1101998a00/0xb7cb3d7479d5f823 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb7cb3d7479d5f81c expref: 19 pid: 5783 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081643.622751:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789081643.622799:0:11518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e1101998a00/0xb7cb3d7479d5f823 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb7cb3d7479d5f81c expref: 19 pid: 5783 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081643.622814:0:11518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d0ef0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11518:1875987821286144:0@lo:104: 00010000:00010000:0.0:1789081643.622835:0:11518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10c29e0600/0xb7cb3d7479d5f815 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb7cb3d7479d5f80e expref: 18 pid: 5783 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081643.622847:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:3306:x1875987821286528:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081643.622852:0:11518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11518:1875987821286272:0@lo:104: 00010000:00010000:0.0:1789081643.622874:0:11518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10c29e0400/0xb7cb3d7479d5f807 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb7cb3d7479d5f800 expref: 17 pid: 5783 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081643.623956:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5f06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821286528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789081643.624179:0:11518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11518:1875987821286400:0@lo:104: 00000100:00100000:3.0:1789081643.624902:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789081643.626952:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081643.627097:0:11518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d0ef3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11518:1875987821285888:192.168.201.17@tcp:104: 00000100:00100000:2.0:1789081643.627179:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796088448 00000100:00100000:2.0:1789081643.627190:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796088448 00010000:00010000:2.0:1789081643.627255:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e10c1487e00/0xb7cb3d7479d5f831 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a803 expref: 13 pid: 5782 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081643.627304:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 33 00000100:00100000:2.0:1789081643.627314:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff700000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2350:x1875987796088448:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789081643.627334:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789081643.627340:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e10c1487e00/0xb7cb3d7479d5f831 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a803 expref: 13 pid: 5782 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081643.627354:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e10c1487e00/0xb7cb3d7479d5f831 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a803 expref: 13 pid: 5782 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081643.627394:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10c1487e00/0xb7cb3d7479d5f831 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a803 expref: 13 pid: 5782 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081643.627416:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789081643.627503:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff700000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+12:2350:x1875987796088448:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 190us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081643.627512:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 33 00000100:00100000:3.0:1789081643.628430:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081643.629116:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796088576 00000100:00100000:2.0:1789081643.629130:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796088576 00010000:00010000:2.0:1789081643.629181:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e1101998000/0xb7cb3d7479d5f82a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a7fc expref: 12 pid: 5783 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081643.629239:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 34 00000100:00100000:2.0:1789081643.629250:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff700380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+12:2351:x1875987796088576:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789081643.629267:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789081643.629274:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e1101998000/0xb7cb3d7479d5f82a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a7fc expref: 12 pid: 5783 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081643.629294:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e1101998000/0xb7cb3d7479d5f82a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a7fc expref: 12 pid: 5783 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081643.629321:0:7481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e1101983c00/0xb7cb3d7479d5f965 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081643.629332:0:7481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e1101983c00/0xb7cb3d7479d5f965 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081643.629358:0:7481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e1101983c00/0xb7cb3d7479d5f965 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081643.629385:0:7481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e1101983c00/0xb7cb3d7479d5f965 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081643.629393:0:7481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e1101983c00/0xb7cb3d7479d5f965 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081643.629400:0:7481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e1101983c00/0xb7cb3d7479d5f965 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081643.629408:0:7481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101983c00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:2.0:1789081643.629414:0:7481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e1101983c00/0xb7cb3d7479d5f965 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081643.629423:0:7481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e1101983c00/0xb7cb3d7479d5f965 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081643.629434:0:7481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e1101983c00/0xb7cb3d7479d5f965 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081643.629447:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789081643.629559:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff700380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+12:2351:x1875987796088576:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 309us (1143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081643.629569:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 34 00010000:00010000:0.0:1789081643.630300:0:11518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e1101998000/0xb7cb3d7479d5f82a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a7fc expref: 11 pid: 5783 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081643.630338:0:11518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d0ef0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11518:1875987821286016:192.168.201.17@tcp:104: 00010000:00010000:0.0:1789081643.630382:0:11518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e1101983c00/0xb7cb3d7479d5f965 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081643.630392:0:11518:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e1101983c00/0xb7cb3d7479d5f965 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081643.630399:0:11518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e1101983c00/0xb7cb3d7479d5f965 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081643.630406:0:11518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e1101983c00/0xb7cb3d7479d5f965 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081643.804766:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789081643.974506:0:7493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 10000000:01000000:0.0:1789081644.764697:0:5786:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789081644.764705:0:5786:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e10ff7e6800 from 7 10000000:01000000:0.0:1789081644.764709:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789081644.764762:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101983200/0xb7cb3d7479d5f96c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081644.764775:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e1101983200/0xb7cb3d7479d5f96c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081644.764787:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e1101983200/0xb7cb3d7479d5f96c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081644.764816:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821286912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789081644.765409:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081644.765497:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821286912 00000100:00100000:3.0:1789081644.765552:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821286912 00000100:00100000:3.0:1789081644.765630:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1789081644.765650:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:5786:x1875987821286912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789081644.765665:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081644.765680:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e1101999c00/0xb7cb3d7479d5f973 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f96c expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081644.765705:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e1101999c00/0xb7cb3d7479d5f973 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f96c expref: 17 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081644.765716:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e1101999c00/0xb7cb3d7479d5f973 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f96c expref: 17 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081644.765727:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101999c00, rc 0) 00000100:00100000:3.0:1789081644.765774:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:5786:x1875987821286912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081644.765781:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1789081644.766494:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c539f000 going to sleep for 11 seconds 00000100:00100000:0.0:1789081644.766548:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821286912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789081644.766567:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e1101983200/0xb7cb3d7479d5f96c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f973 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081644.766577:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e1101983200/0xb7cb3d7479d5f96c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f973 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081644.766656:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821287040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789081644.766704:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081644.766781:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821287040 00000100:00100000:2.0:1789081644.766787:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821287040 00000100:00100000:2.0:1789081644.766817:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1789081644.766825:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:5786:x1875987821287040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789081644.767087:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:5786:x1875987821287040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 262us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081644.767104:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789081644.772397:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c539f000 going to sleep for 11 seconds 00000100:00100000:0.0:1789081644.772553:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821287040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789081644.772637:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821287168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789081644.772742:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081644.772844:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c539f000 going to sleep for 11 seconds 00000100:00100000:3.0:1789081644.777045:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821287168 00000100:00100000:3.0:1789081644.777062:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821287168 00000100:00100000:3.0:1789081644.777191:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789081644.777202:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:5786:x1875987821287168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789081644.777455:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:5786:x1875987821287168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 255us (4713us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081644.777464:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1789081644.777562:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821287168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789081644.780650:0:11534:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:11534:1875987821287296:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789081644.780731:0:11534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081644.782092:0:11534:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c539f840 going to sleep for 11 seconds 00000100:00100000:2.0:1789081644.789413:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821287296 00000100:00100000:2.0:1789081644.789431:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821287296 00000100:00100000:2.0:1789081644.789499:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789081644.789509:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:11534:x1875987821287296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789081644.789850:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:11534:x1875987821287296:12345-0@lo:502:llog_process_th.0 Request processed in 340us (9116us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081644.789858:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1789081644.790253:0:11534:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:11534:1875987821287296:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789081644.790291:0:11534:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789081644.790301:0:11534:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789081644.790303:0:11534:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789081644.790309:0:11534:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e10ff7e6800 00000020:00000080:0.0:1789081644.790312:0:11534:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789081644.790412:0:11534:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:11534:1875987821287424:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789081644.790468:0:11534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081644.790501:0:11534:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c539f840 going to sleep for 11 seconds 00000100:00100000:3.0:1789081644.793086:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821287424 00000100:00100000:3.0:1789081644.793103:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821287424 00000100:00100000:3.0:1789081644.793163:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789081644.793173:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:11534:x1875987821287424:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789081644.793471:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:11534:x1875987821287424:12345-0@lo:502:llog_process_th.0 Request processed in 299us (3002us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081644.793480:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1789081644.797310:0:11534:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:11534:1875987821287424:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789081644.797356:0:11534:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789081644.797366:0:11534:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789081644.797369:0:11534:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789081644.797374:0:11534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789081644.801173:0:5786:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789081644.801218:0:5786:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789081644.801230:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101983200/0xb7cb3d7479d5f96c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f973 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081644.801256:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e1101983200/0xb7cb3d7479d5f96c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f973 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789081644.804128:0:5786:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789081644.804136:0:5786:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e10fad3e000 from 7 10000000:01000000:0.0:1789081644.804140:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789081644.804188:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101982c00/0xb7cb3d7479d5f97a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081644.804200:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e1101982c00/0xb7cb3d7479d5f97a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081644.804212:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e1101982c00/0xb7cb3d7479d5f97a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081644.804240:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821287552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789081644.804318:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081644.804364:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c539f840 going to sleep for 11 seconds 00000100:00100000:1.0:1789081644.804439:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821287552 00000100:00100000:1.0:1789081644.804448:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821287552 00000100:00100000:1.0:1789081644.804503:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1789081644.804512:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:5786:x1875987821287552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789081644.804548:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081644.804562:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10e13aea00/0xb7cb3d7479d5f981 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f97a expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081644.804586:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10e13aea00/0xb7cb3d7479d5f981 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f97a expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081644.804608:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10e13aea00/0xb7cb3d7479d5f981 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f97a expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081644.804617:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13aea00, rc 0) 00000100:00100000:1.0:1789081644.804658:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:5786:x1875987821287552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081644.804664:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789081644.805166:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821287552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789081644.805181:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e1101982c00/0xb7cb3d7479d5f97a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f981 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081644.805190:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e1101982c00/0xb7cb3d7479d5f97a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f981 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081644.805268:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821287680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789081644.805302:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081644.805328:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c539f840 going to sleep for 11 seconds 00000100:00100000:1.0:1789081644.809238:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821287680 00000100:00100000:1.0:1789081644.809256:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821287680 00000100:00100000:1.0:1789081644.809335:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789081644.809346:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:5786:x1875987821287680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789081644.809764:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:5786:x1875987821287680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 419us (4459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081644.809782:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789081644.810042:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821287680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789081644.810094:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821287808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789081644.810141:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081644.810173:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c539f840 going to sleep for 11 seconds 00000100:00100000:1.0:1789081644.811413:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821287808 00000100:00100000:1.0:1789081644.811424:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821287808 00000100:00100000:1.0:1789081644.811488:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789081644.811497:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:5786:x1875987821287808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789081644.811889:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:5786:x1875987821287808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 392us (1746us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081644.811972:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789081644.812614:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821287808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789081644.812833:0:11537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:11537:1875987821287936:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789081644.812884:0:11537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081644.813126:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821287936 00000100:00100000:0.0:1789081644.813131:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821287936 00000100:00100000:0.0:1789081644.813166:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789081644.813174:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:11537:x1875987821287936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789081644.813351:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:11537:x1875987821287936:12345-0@lo:502:llog_process_th.0 Request processed in 177us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081644.813359:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789081644.813406:0:11537:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c539fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789081644.813421:0:11537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:11537:1875987821287936:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789081644.813442:0:11537:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789081644.813759:0:11537:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789081644.813761:0:11537:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789081644.813770:0:11537:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e10fad3e000 00000020:00000080:0.0:1789081644.813782:0:11537:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789081644.815016:0:11537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:11537:1875987821288064:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789081644.815081:0:11537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081644.815126:0:11537:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d0d599c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789081644.815285:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821288064 00000100:00100000:3.0:1789081644.815292:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821288064 00000100:00100000:3.0:1789081644.815342:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789081644.815351:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:11537:x1875987821288064:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789081644.815673:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:11537:x1875987821288064:12345-0@lo:502:llog_process_th.0 Request processed in 322us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081644.815695:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789081644.816949:0:11537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:11537:1875987821288064:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789081644.816992:0:11537:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789081644.817006:0:11537:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789081644.817010:0:11537:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789081644.817014:0:11537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789081644.817415:0:5786:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1789081644.817439:0:5786:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789081644.817459:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101982c00/0xb7cb3d7479d5f97a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f981 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081644.817471:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e1101982c00/0xb7cb3d7479d5f97a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f981 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789081644.817492:0:5786:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789081644.817494:0:5786:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e10ee974800 from 7 10000000:01000000:3.0:1789081644.817497:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789081644.817550:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101999800/0xb7cb3d7479d5f988 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081644.817558:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e1101999800/0xb7cb3d7479d5f988 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081644.817568:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e1101999800/0xb7cb3d7479d5f988 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081644.817589:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff700e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821288192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789081644.817660:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081644.817860:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c8e83f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789081644.817986:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821288192 00000100:00100000:1.0:1789081644.817993:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821288192 00000100:00100000:1.0:1789081644.818043:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789081644.818052:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:5786:x1875987821288192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789081644.818065:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081644.818088:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10e13af200/0xb7cb3d7479d5f98f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d5f988 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081644.818114:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10e13af200/0xb7cb3d7479d5f98f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f988 expref: 19 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081644.818125:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10e13af200/0xb7cb3d7479d5f98f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d5f988 expref: 19 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081644.818134:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13af200, rc 0) 00000100:00100000:1.0:1789081644.818173:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:5786:x1875987821288192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081644.818180:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789081644.818218:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff700e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821288192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789081644.818239:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e1101999800/0xb7cb3d7479d5f988 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f98f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081644.818249:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e1101999800/0xb7cb3d7479d5f988 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f98f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081644.818302:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5f06300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821288320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789081644.818326:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081644.818341:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d1656d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789081644.818707:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821288320 00000100:00100000:3.0:1789081644.818712:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821288320 00000100:00100000:3.0:1789081644.818742:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789081644.818749:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:5786:x1875987821288320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789081644.819165:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:5786:x1875987821288320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 415us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081644.819174:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789081644.819215:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5f06300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821288320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789081644.819252:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff701500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821288448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789081644.819287:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081644.819303:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c8e83480 going to sleep for 11 seconds 00000100:00100000:3.0:1789081644.819319:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821288448 00000100:00100000:3.0:1789081644.819323:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821288448 00000100:00100000:3.0:1789081644.819344:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789081644.819350:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:5786:x1875987821288448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789081644.820315:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:5786:x1875987821288448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 960us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081644.820326:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789081644.820387:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff701500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ee551687-7675-4fc6-9be1-2ccb62bdd809:5786:1875987821288448:0@lo:503:ll_cfg_requeue.0 00010000:00010000:1.0:1789081644.829829:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789081644.837609:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789081644.837824:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2def480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:11538:1875987821288576:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789081644.838044:0:11538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081644.838092:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10ff6b1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789081644.839353:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821288576 00000100:00100000:1.0:1789081644.839365:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821288576 00000100:00100000:1.0:1789081644.839420:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789081644.839430:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:11538:x1875987821288576:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789081644.839734:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:11538:x1875987821288576:12345-0@lo:502:llog_process_th.0 Request processed in 305us (1689us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081644.839743:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789081644.839909:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2def480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:11538:1875987821288576:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789081644.839944:0:11538:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789081644.839954:0:11538:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789081644.839956:0:11538:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789081644.839965:0:11538:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e10ee974800 00000020:00000080:2.0:1789081644.839968:0:11538:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789081644.840064:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2def480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:11538:1875987821288704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789081644.840119:0:11538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081644.840156:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10ff6b1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789081644.840473:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821288704 00000100:00100000:3.0:1789081644.840479:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821288704 00000100:00100000:3.0:1789081644.840520:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789081644.840553:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:11538:x1875987821288704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789081644.840726:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:11538:x1875987821288704:12345-0@lo:502:llog_process_th.0 Request processed in 174us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081644.840734:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789081644.840825:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2def480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ee551687-7675-4fc6-9be1-2ccb62bdd809:11538:1875987821288704:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789081644.840849:0:11538:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789081644.840855:0:11538:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789081644.840856:0:11538:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789081644.840862:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789081644.845641:0:5786:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1789081644.845684:0:5786:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789081644.845696:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101999800/0xb7cb3d7479d5f988 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f98f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081644.845710:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e1101999800/0xb7cb3d7479d5f988 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f98f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081644.893002:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821288832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789081644.893084:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081644.893662:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821288832 00000100:00100000:3.0:1789081644.893672:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821288832 00000100:00100000:3.0:1789081644.893767:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789081644.893777:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821288832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789081644.893841:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789081644.893907:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821288832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081644.893915:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1789081644.894077:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e11006a4000 x1875987821288832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081660 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789081644.894101:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821288832:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789081644.896619:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789081645.151349:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081645.151432:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796088704 00000100:00100000:0.0:1789081645.151444:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796088704 00000100:00100000:0.0:1789081645.151510:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 268 00000100:00100000:0.0:1789081645.151520:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+11:5569:x1875987796088704:12345-192.168.201.17@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789081645.151560:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081645.151577:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e1101983e00/0xb7cb3d7479d5f996 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a850 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081645.151720:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e1101983e00/0xb7cb3d7479d5f996 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a850 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081645.151732:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e1101983e00/0xb7cb3d7479d5f996 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a850 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081645.151741:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101983e00, rc 0) 00000100:00100000:0.0:1789081645.151800:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+12:5569:x1875987796088704:12345-192.168.201.17@tcp:101:ll_cfg_requeue.0 Request processed in 281us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081645.151807:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 268 00000100:00100000:3.0:1789081645.156025:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081645.156190:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796088832 00000100:00100000:2.0:1789081645.156202:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796088832 00000100:00100000:2.0:1789081645.156264:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 269 00000100:00100000:2.0:1789081645.156274:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+12:5569:x1875987796088832:12345-192.168.201.17@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789081645.156841:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+12:5569:x1875987796088832:12345-192.168.201.17@tcp:501:ll_cfg_requeue.0 Request processed in 566us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081645.156850:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 269 00000100:00100000:3.0:1789081645.170179:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081645.171237:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796088960 00000100:00100000:0.0:1789081645.171268:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796088960 00000100:00100000:0.0:1789081645.171335:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 270 00000100:00100000:0.0:1789081645.171346:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+12:5569:x1875987796088960:12345-192.168.201.17@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789081645.171695:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+12:5569:x1875987796088960:12345-192.168.201.17@tcp:503:ll_cfg_requeue.0 Request processed in 349us (1525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081645.171702:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 270 00000100:00100000:0.0:1789081645.185490:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081645.185804:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796089088 00000100:00100000:3.0:1789081645.185814:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796089088 00000100:00100000:3.0:1789081645.185873:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 271 00000100:00100000:3.0:1789081645.185883:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c51b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+12:9945:x1875987796089088:12345-192.168.201.17@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789081645.186162:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c51b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+12:9945:x1875987796089088:12345-192.168.201.17@tcp:502:llog_process_th.0 Request processed in 279us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081645.186171:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 271 00000100:00100000:3.0:1789081645.194046:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081645.194202:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796089216 00000100:00100000:2.0:1789081645.194213:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796089216 00000100:00100000:2.0:1789081645.194267:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 272 00000100:00100000:2.0:1789081645.194277:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+12:9945:x1875987796089216:12345-192.168.201.17@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789081645.194579:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+12:9945:x1875987796089216:12345-192.168.201.17@tcp:502:llog_process_th.0 Request processed in 303us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081645.194596:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 272 00000100:00100000:2.0:1789081645.198804:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081645.198902:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796089344 00000100:00100000:0.0:1789081645.198913:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796089344 00000100:00100000:0.0:1789081645.198967:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 273 00000100:00100000:0.0:1789081645.198978:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+12:5569:x1875987796089344:12345-192.168.201.17@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789081645.198994:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081645.199023:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e1101982800/0xb7cb3d7479d5f99d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a857 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081645.199054:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e1101982800/0xb7cb3d7479d5f99d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a857 expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081645.199076:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e1101982800/0xb7cb3d7479d5f99d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a857 expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081645.199085:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101982800, rc 0) 00000100:00100000:0.0:1789081645.199144:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:5569:x1875987796089344:12345-192.168.201.17@tcp:101:ll_cfg_requeue.0 Request processed in 168us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081645.199151:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 273 00000100:00100000:0.0:1789081645.206161:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081645.206270:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796089472 00000100:00100000:3.0:1789081645.206280:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796089472 00000100:00100000:3.0:1789081645.206400:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 274 00000100:00100000:3.0:1789081645.206409:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:5569:x1875987796089472:12345-192.168.201.17@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789081645.206832:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:5569:x1875987796089472:12345-192.168.201.17@tcp:501:ll_cfg_requeue.0 Request processed in 421us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081645.206840:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 274 00000100:00100000:3.0:1789081645.216378:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081645.216609:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796089600 00000100:00100000:2.0:1789081645.216619:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796089600 00000100:00100000:2.0:1789081645.216720:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 275 00000100:00100000:2.0:1789081645.216731:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:5569:x1875987796089600:12345-192.168.201.17@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789081645.216962:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:5569:x1875987796089600:12345-192.168.201.17@tcp:503:ll_cfg_requeue.0 Request processed in 232us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081645.216972:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 275 00000100:00100000:2.0:1789081645.241329:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081645.243975:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796089728 00000100:00100000:0.0:1789081645.244008:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796089728 00000100:00100000:0.0:1789081645.244085:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 276 00000100:00100000:0.0:1789081645.244097:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:9948:x1875987796089728:12345-192.168.201.17@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789081645.244376:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:9948:x1875987796089728:12345-192.168.201.17@tcp:502:llog_process_th.0 Request processed in 280us (3056us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081645.244384:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 276 00000100:00100000:0.0:1789081645.253315:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081645.253504:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796089856 00000100:00100000:2.0:1789081645.253514:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796089856 00000100:00100000:2.0:1789081645.253603:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 277 00000100:00100000:2.0:1789081645.253625:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:9948:x1875987796089856:12345-192.168.201.17@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789081645.253867:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:9948:x1875987796089856:12345-192.168.201.17@tcp:502:llog_process_th.0 Request processed in 242us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081645.253875:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 277 00000100:00100000:1.0:1789081645.405095:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821288960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789081645.405169:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081645.405426:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821288960 00000100:00100000:2.0:1789081645.405435:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821288960 00000100:00100000:2.0:1789081645.405503:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789081645.405512:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821288960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789081645.405565:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789081645.405624:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821288960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081645.405633:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789081645.405723:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1789081645.405729:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e10d2ded500, transno 4294967300 00000100:00100000:1.0:1789081645.405752:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821288960:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789081645.405817:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789081645.406487:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821289472:0@lo:400:kworker.0 00000100:00100000:0.0:1789081645.406557:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081645.406601:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789081645.406608:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875987821289344:0@lo:400:kworker.0 00000100:00100000:0.0:1789081645.406632:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081645.406660:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821289344 00000100:00100000:0.0:1789081645.406664:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821289344 00000100:00100000:3.0:1789081645.406764:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875987821289216:0@lo:400:kworker.0 00000100:00100000:3.0:1789081645.406804:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081645.406825:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789081645.406830:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821289088:0@lo:400:kworker.0 00000100:00100000:3.0:1789081645.406856:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081645.406878:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875987821289600:0@lo:400:kworker.0 00000100:00100000:3.0:1789081645.406900:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081645.406925:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821289472 00000100:00100000:3.0:1789081645.406929:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821289472 00000100:00100000:3.0:1789081645.406965:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789081645.406972:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11006a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821289472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081645.407015:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11006a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821289472:12345-0@lo:400:kworker.0 Request processed in 43us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081645.407023:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789081645.407042:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821289216 00000100:00100000:3.0:1789081645.407045:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821289216 00000100:00100000:3.0:1789081645.407081:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821289600 00000100:00100000:3.0:1789081645.407084:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821289600 00000100:00100000:0.0:1789081645.407131:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789081645.407138:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff701500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875987821289216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081645.407174:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff701500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875987821289216:12345-0@lo:400:kworker.0 Request processed in 37us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081645.407181:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789081645.407192:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789081645.407209:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11006a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875987821289344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081645.407240:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11006a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875987821289344:12345-0@lo:400:kworker.0 Request processed in 42us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081645.407245:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789081645.407301:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875987821289344:0@lo:400:kworker.0 00010000:00080000:0.0:1789081645.407325:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e11006a7b80 x1875987821289472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789081661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081645.407335:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821289472:0@lo:400:kworker.0 00000100:00100000:0.0:1789081645.407357:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821289088 00000100:00100000:0.0:1789081645.407360:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821289088 00000100:00100000:0.0:1789081645.407382:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1789081645.407388:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3304:x1875987821289088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081645.407418:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3304:x1875987821289088:12345-0@lo:400:kworker.0 Request processed in 30us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081645.407424:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1789081645.407618:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821289088:0@lo:400:kworker.0 00000100:00100000:2.0:1789081645.407630:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875987821289216:0@lo:400:kworker.0 00000100:00100000:3.0:1789081645.411850:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789081645.411868:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff700e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875987821289600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081645.411999:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff700e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875987821289600:12345-0@lo:400:kworker.0 Request processed in 136us (5095us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081645.412007:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789081645.412450:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875987821289600:0@lo:400:kworker.0 00000100:00080000:0.0:1789081645.412602:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1789081645.853857:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789081645.854414:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789081646.039986:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081646.040028:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081646.040061:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081646.040238:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796089984 00000100:00100000:0.0:1789081646.040248:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796089984 00000100:00100000:3.0:1789081646.040264:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796090240 00000100:00100000:3.0:1789081646.040269:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796090240 00000100:00100000:0.0:1789081646.040318:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 114 00000100:00100000:0.0:1789081646.040328:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+5:2349:x1875987796089984:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:2.0:1789081646.040344:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796090112 00000100:00100000:2.0:1789081646.040348:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796090112 00000100:00100000:2.0:1789081646.040390:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 39 00000100:00100000:2.0:1789081646.040398:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41476931-e751-413e-b98c-64d4d0edcd05+5:2349:x1875987796090112:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:0.0:1789081646.040404:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+5:2349:x1875987796089984:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 79us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081646.040411:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 114 00000100:00100000:2.0:1789081646.040424:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41476931-e751-413e-b98c-64d4d0edcd05+5:2349:x1875987796090112:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 28us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081646.040430:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 39 00000100:00080000:1.0:1789081646.040457:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789081646.040462:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789081646.045319:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 115 00000100:00100000:3.0:1789081646.045351:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03f7db20-3934-4266-b84f-346a4ea22636+5:2349:x1875987796090240:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081646.045467:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03f7db20-3934-4266-b84f-346a4ea22636+5:2349:x1875987796090240:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 125us (5437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081646.045489:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 115 00010000:00010000:3.0:1789081646.877659:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081647.902240:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081648.924947:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081649.948801:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789081650.013781:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789081650.013829:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821289728:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789081650.013909:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081650.014263:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821289728 00000100:00100000:3.0:1789081650.014273:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821289728 00000100:00100000:3.0:1789081650.014338:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789081650.014346:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821289728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789081650.014381:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789081650.014431:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821289728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081650.014439:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1789081650.014475:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e11006a7b80 x1875987821289728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081666 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789081650.014494:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821289728:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789081650.015088:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789081650.524920:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821289856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789081650.524997:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081650.525217:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821289856 00000100:00100000:2.0:1789081650.525226:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821289856 00000100:00100000:2.0:1789081650.525330:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789081650.525340:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821289856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789081650.525373:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789081650.525419:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821289856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081650.525427:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1789081650.525550:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789081650.525626:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821289856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789081650.526225:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875987821290240:0@lo:400:kworker.0 00000100:00100000:2.0:1789081650.526259:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081650.526280:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789081650.526285:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875987821290112:0@lo:400:kworker.0 00000100:00100000:2.0:1789081650.526304:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081650.526373:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821289984:0@lo:400:kworker.0 00000100:00100000:1.0:1789081650.526398:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821290240 00000100:00100000:1.0:1789081650.526405:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821290240 00000100:00100000:0.0:1789081650.526410:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081650.526453:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821290112 00000100:00100000:0.0:1789081650.526455:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2deed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875987821290496:0@lo:400:kworker.0 00000100:00100000:1.0:1789081650.526458:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821290112 00000100:00100000:0.0:1789081650.526484:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081650.526488:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789081650.526514:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875987821290240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081650.526518:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789081650.526559:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821290368:0@lo:400:kworker.0 00000100:00100000:1.0:1789081650.526586:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875987821290240:12345-0@lo:400:kworker.0 Request processed in 74us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081650.526594:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789081650.526599:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081650.526608:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821290496 00000100:00100000:1.0:1789081650.526613:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821290496 00000100:00100000:1.0:1789081650.526633:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789081650.526644:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821290368 00000100:00100000:1.0:1789081650.526649:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875987821290112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081650.526650:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821290368 00000100:00100000:0.0:1789081650.526688:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789081650.526692:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875987821290112:12345-0@lo:400:kworker.0 Request processed in 44us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081650.526700:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11006a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821290368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081650.526704:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789081650.526721:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789081650.526729:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11006a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875987821290496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081650.526745:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11006a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821290368:12345-0@lo:400:kworker.0 Request processed in 48us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081650.526752:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789081650.526768:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11006a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875987821290496:12345-0@lo:400:kworker.0 Request processed in 39us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081650.526776:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00010000:00080000:0.0:1789081650.526793:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10d2deea00 x1875987821290368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789081666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789081650.526803:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789081650.526808:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821290368:0@lo:400:kworker.0 00000100:00100000:1.0:1789081650.526827:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875987821290112:0@lo:400:kworker.0 00000100:00100000:0.0:1789081650.526829:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2deed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875987821290496:0@lo:400:kworker.0 00000100:00100000:1.0:1789081650.526849:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875987821290240:0@lo:400:kworker.0 00000100:00100000:2.0:1789081650.528373:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821289984 00000100:00100000:2.0:1789081650.528384:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821289984 00000100:00100000:2.0:1789081650.528438:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1789081650.528447:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3306:x1875987821289984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789081650.528565:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3306:x1875987821289984:12345-0@lo:400:kworker.0 Request processed in 120us (2154us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081650.528571:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1789081650.528981:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821289984:0@lo:400:kworker.0 00010000:00010000:3.0:1789081650.974294:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789081651.160176:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081651.160228:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081651.160268:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081651.160368:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796090624 00000100:00100000:3.0:1789081651.160378:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796090624 00000100:00100000:1.0:1789081651.160419:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00080000:1.0:1789081651.160440:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789081651.160453:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796090496 00000100:00100000:1.0:1789081651.160456:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796090496 00000100:00100000:3.0:1789081651.160466:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 41 00000100:00100000:3.0:1789081651.160478:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41476931-e751-413e-b98c-64d4d0edcd05+5:2351:x1875987796090624:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:1.0:1789081651.160511:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796090752 00000100:00100000:1.0:1789081651.160516:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796090752 00000100:00100000:1.0:1789081651.160590:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 119 00000100:00100000:3.0:1789081651.160592:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41476931-e751-413e-b98c-64d4d0edcd05+5:2351:x1875987796090624:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 114us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081651.160601:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+5:2351:x1875987796090496:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081651.160621:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 41 00000100:00100000:1.0:1789081651.160640:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+5:2351:x1875987796090496:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 39us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081651.160655:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 119 00000100:00100000:1.0:1789081651.160673:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 120 00000100:00100000:1.0:1789081651.160681:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03f7db20-3934-4266-b84f-346a4ea22636+5:2351:x1875987796090752:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:1.0:1789081651.160711:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03f7db20-3934-4266-b84f-346a4ea22636+5:2351:x1875987796090752:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 31us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081651.160718:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 120 00000100:00080000:1.0:1789081651.160759:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789081651.160831:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796090368 00000100:00100000:2.0:1789081651.160836:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796090368 00000100:00100000:2.0:1789081651.160874:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 280 00000100:00100000:2.0:1789081651.160890:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2351:x1875987796090368:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:2.0:1789081651.160965:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2351:x1875987796090368:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 84us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081651.160972:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 280 00010000:00010000:1.0:1789081651.999686:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081653.022642:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081654.049639:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789081655.069718:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789081655.070274:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081655.132843:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821290624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789081655.132918:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081655.133044:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821290624 00000100:00100000:2.0:1789081655.133063:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821290624 00000100:00100000:2.0:1789081655.133124:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789081655.133131:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821290624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789081655.133162:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789081655.133206:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821290624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081655.133213:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1789081655.133400:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789081655.133439:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e11006a7b80 x1875987821290624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081671 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789081655.133454:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821290624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789081655.645118:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789081655.645143:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821290752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789081655.645211:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081655.645380:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821290752 00000100:00100000:2.0:1789081655.645388:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821290752 00000100:00100000:2.0:1789081655.645464:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789081655.645473:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821290752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789081655.645519:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789081655.645584:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821290752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081655.645591:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1789081655.646634:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789081655.646686:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821290752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789081655.647687:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875987821291008:0@lo:400:kworker.0 00000100:00100000:1.0:1789081655.647749:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081655.647799:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789081655.647806:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821290880:0@lo:400:kworker.0 00000100:00100000:1.0:1789081655.647843:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081655.647896:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821290880 00000100:00100000:1.0:1789081655.647903:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821290880 00000100:00100000:1.0:1789081655.647944:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1789081655.647952:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3306:x1875987821290880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081655.647995:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3306:x1875987821290880:12345-0@lo:400:kworker.0 Request processed in 43us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081655.648001:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1789081655.648040:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821290880:0@lo:400:kworker.0 00000100:00100000:3.0:1789081655.648253:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875987821291136:0@lo:400:kworker.0 00000100:00100000:3.0:1789081655.648276:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081655.648297:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789081655.648300:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875987821291264:0@lo:400:kworker.0 00000100:00100000:3.0:1789081655.648313:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081655.648436:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821291008 00000100:00100000:2.0:1789081655.648444:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821291008 00000100:00100000:2.0:1789081655.648473:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821291136 00000100:00100000:2.0:1789081655.648476:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821291136 00000100:00100000:2.0:1789081655.648512:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821291264 00000100:00100000:2.0:1789081655.648514:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821291264 00000100:00100000:2.0:1789081655.648546:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789081655.648552:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875987821291008:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789081655.648565:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789081655.648585:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789081655.648590:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875987821291008:12345-0@lo:400:kworker.0 Request processed in 39us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081655.648592:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875987821291136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789081655.648596:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789081655.648609:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789081655.648614:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875987821291264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081655.648625:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875987821291136:12345-0@lo:400:kworker.0 Request processed in 35us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081655.648636:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789081655.648653:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875987821291264:12345-0@lo:400:kworker.0 Request processed in 39us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081655.648658:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789081655.648660:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875987821291264:0@lo:400:kworker.0 00000100:00100000:3.0:1789081655.648744:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875987821291136:0@lo:400:kworker.0 00000100:00100000:1.0:1789081655.648929:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875987821291008:0@lo:400:kworker.0 00010000:00010000:1.0:1789081656.092945:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789081656.280759:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081656.281290:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796090880 00000100:00100000:3.0:1789081656.281301:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796090880 00000100:00100000:3.0:1789081656.281359:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 282 00000100:00100000:3.0:1789081656.281369:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2351:x1875987796090880:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081656.281458:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2351:x1875987796090880:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 90us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081656.281466:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 282 00000100:00100000:1.0:1789081656.288835:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081656.288873:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081656.288944:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081656.289075:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796091008 00000100:00100000:3.0:1789081656.289085:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796091008 00000100:00100000:3.0:1789081656.289153:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796091264 00000100:00100000:3.0:1789081656.289157:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796091264 00000100:00100000:3.0:1789081656.289179:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 124 00000100:00100000:3.0:1789081656.289188:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+5:2351:x1875987796091008:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081656.289259:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+5:2351:x1875987796091008:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 71us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081656.289266:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 124 00000100:00100000:3.0:1789081656.289284:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 125 00000100:00100000:3.0:1789081656.289290:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03f7db20-3934-4266-b84f-346a4ea22636+5:2350:x1875987796091264:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081656.289315:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03f7db20-3934-4266-b84f-346a4ea22636+5:2350:x1875987796091264:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 26us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081656.289321:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 125 00000100:00100000:0.0:1789081656.289470:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796091136 00000100:00100000:0.0:1789081656.289475:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796091136 00000100:00100000:0.0:1789081656.289514:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 42 00000100:00100000:0.0:1789081656.289520:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41476931-e751-413e-b98c-64d4d0edcd05+5:2351:x1875987796091136:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:0.0:1789081656.289590:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41476931-e751-413e-b98c-64d4d0edcd05+5:2351:x1875987796091136:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 70us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081656.289596:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 42 00000100:00080000:1.0:1789081656.291364:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789081656.291374:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789081657.117285:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081658.141753:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081659.165242:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081660.189065:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081660.258173:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821291392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789081660.258254:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081660.258415:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821291392 00000100:00100000:2.0:1789081660.258424:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821291392 00000100:00100000:2.0:1789081660.258488:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789081660.258497:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821291392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789081660.258579:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789081660.268811:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789081660.270288:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821291392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 11782us (12026us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081660.270303:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1789081660.271111:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e11006a6a00 x1875987821291392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081676 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789081660.271209:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821291392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789081660.765262:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875987821291904:0@lo:400:kworker.0 00000100:00100000:3.0:1789081660.765375:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081660.765452:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789081660.765458:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821291520:0@lo:400:kworker.0 00000100:00100000:3.0:1789081660.765488:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081660.765510:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821292032:0@lo:400:kworker.0 00000100:00100000:3.0:1789081660.765768:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081660.765809:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875987821291648:0@lo:400:kworker.0 00000100:00100000:3.0:1789081660.765837:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081660.765856:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789081660.765862:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875987821291776:0@lo:400:kworker.0 00000100:00100000:3.0:1789081660.765883:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081660.765914:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821292032 00000100:00100000:3.0:1789081660.765924:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821292032 00000100:00100000:3.0:1789081660.765991:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789081660.766000:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c8a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821292032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081660.766053:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c8a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821292032:12345-0@lo:400:kworker.0 Request processed in 54us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081660.766070:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789081660.766095:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821291904 00000100:00100000:3.0:1789081660.766099:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821291904 00000100:00100000:1.0:1789081660.766228:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821291520 00000100:00100000:1.0:1789081660.766233:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821291520 00000100:00100000:1.0:1789081660.766276:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1789081660.766283:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3305:x1875987821291520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081660.766328:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3305:x1875987821291520:12345-0@lo:400:kworker.0 Request processed in 46us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081660.766335:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00080000:1.0:1789081660.766365:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789081660.766368:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789081660.766399:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821291648 00000100:00100000:1.0:1789081660.766402:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821291648 00000100:00100000:1.0:1789081660.766423:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821291776 00000100:00100000:1.0:1789081660.766426:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821291776 00000100:00100000:1.0:1789081660.766458:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789081660.766464:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c8a1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875987821291648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081660.766499:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c8a1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875987821291648:12345-0@lo:400:kworker.0 Request processed in 36us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081660.766505:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789081660.766516:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789081660.766909:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c8a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875987821291776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081660.766960:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c8a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875987821291776:12345-0@lo:400:kworker.0 Request processed in 438us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081660.766967:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789081660.767012:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875987821291776:0@lo:400:kworker.0 00000100:00100000:1.0:1789081660.767026:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875987821291648:0@lo:400:kworker.0 00000100:00080000:1.0:1789081660.767056:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789081660.767081:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821291520:0@lo:400:kworker.0 00000100:00100000:1.0:1789081660.767092:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821292032:0@lo:400:kworker.0 00000100:00100000:3.0:1789081660.767359:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789081660.767368:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875987821291904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081660.772482:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789081660.772506:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2def100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821292160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789081660.772606:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081660.772810:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821292160 00000100:00100000:2.0:1789081660.772818:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821292160 00000100:00100000:2.0:1789081660.772879:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789081660.772889:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11006a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821292160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789081660.772925:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789081660.772975:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11006a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821292160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081660.772982:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789081660.773027:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2def100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821292160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789081660.775416:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875987821291904:12345-0@lo:400:kworker.0 Request processed in 8040us (10031us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081660.775429:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789081660.779471:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875987821291904:0@lo:400:kworker.0 00010000:00010000:3.0:1789081661.216626:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789081661.405363:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081661.405410:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081661.405501:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796091392 00000100:00100000:1.0:1789081661.405511:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796091392 00000100:00100000:1.0:1789081661.405590:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 284 00000100:00100000:1.0:1789081661.405602:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2351:x1875987796091392:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:1.0:1789081661.405744:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2351:x1875987796091392:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 120us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081661.405752:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 284 00000100:00100000:2.0:1789081661.406115:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796091520 00000100:00100000:2.0:1789081661.406120:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796091520 00000100:00100000:2.0:1789081661.406170:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 129 00000100:00100000:2.0:1789081661.406177:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11006a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+5:2351:x1875987796091520:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:2.0:1789081661.406218:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11006a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+5:2351:x1875987796091520:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 41us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081661.406240:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 129 00000100:00080000:1.0:1789081661.406334:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789081661.417244:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081661.420414:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081661.421295:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796091648 00000100:00100000:3.0:1789081661.421318:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796091648 00000100:00100000:3.0:1789081661.421411:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 19 00000100:00100000:3.0:1789081661.421423:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11006a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41476931-e751-413e-b98c-64d4d0edcd05+5:2347:x1875987796091648:12345-192.168.201.17@tcp:9:kworker.0 00000020:00000080:3.0:1789081661.421467:0:6582:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb7cb3d7479d5f8d9 00000100:00080000:3.0:1789081661.421476:0:6582:0:(import.c:65:import_set_state_nolock()) ffff9e10f97ed000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789081661.421561:0:6582:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1789081661.421854:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11006a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41476931-e751-413e-b98c-64d4d0edcd05+2:2347:x1875987796091648:12345-192.168.201.17@tcp:9:kworker.0 Request processed in 433us (1452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081661.421862:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 19 00010000:00010000:3.0:1789081661.422497:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789081661.423226:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789081661.423779:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796091776 00000100:00100000:1.0:1789081661.423790:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796091776 00000100:00100000:1.0:1789081661.423882:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 130 00000100:00100000:1.0:1789081661.423891:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11006a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03f7db20-3934-4266-b84f-346a4ea22636+5:2350:x1875987796091776:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:1.0:1789081661.423982:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11006a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03f7db20-3934-4266-b84f-346a4ea22636+5:2350:x1875987796091776:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 92us (6748us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081661.424006:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 130 00000100:00080000:2.0:1789081661.424679:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789081662.239742:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081663.260804:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081664.289482:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789081664.457406:0:7493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 41476931-e751-413e-b98c-64d4d0edcd05 00000020:00000080:1.0:1789081664.457415:0:7493:0:(genops.c:906:class_export_put()) final put ffff9e10f97eb000/41476931-e751-413e-b98c-64d4d0edcd05 00000020:00000080:1.0:1789081664.457459:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e10f97eb000/41476931-e751-413e-b98c-64d4d0edcd05 for lustre-OST0001 00000020:00000080:1.0:1789081664.457503:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e10f97ed000 for lustre-OST0001 00010000:00010000:1.0:1789081665.308697:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789081665.309287:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789081665.376883:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821292288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789081665.376971:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081665.377207:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821292288 00000100:00100000:0.0:1789081665.377215:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821292288 00000100:00100000:0.0:1789081665.377293:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789081665.377302:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2def100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821292288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789081665.377351:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789081665.377398:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2def100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821292288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081665.377406:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1789081665.378168:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789081665.378207:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e11006a7b80 x1875987821292288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081681 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789081665.378239:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821292288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789081665.888232:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789081665.888257:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff5dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821292416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789081665.888328:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081665.888396:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821292416 00000100:00100000:1.0:1789081665.888405:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821292416 00000100:00100000:1.0:1789081665.888459:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789081665.888467:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821292416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789081665.888502:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789081665.888583:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821292416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081665.888590:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1789081665.888610:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789081665.888836:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875987821292672:0@lo:400:kworker.0 00000100:00100000:1.0:1789081665.888868:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081665.888890:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789081665.888896:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d11fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875987821292800:0@lo:400:kworker.0 00000100:00100000:1.0:1789081665.888917:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081665.888975:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821292672 00000100:00100000:1.0:1789081665.888979:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821292672 00000100:00100000:1.0:1789081665.889013:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821292800 00000100:00100000:1.0:1789081665.889016:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821292800 00000100:00100000:0.0:1789081665.889201:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d11ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875987821292928:0@lo:400:kworker.0 00000100:00100000:0.0:1789081665.889248:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081665.889269:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789081665.889274:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821292544:0@lo:400:kworker.0 00000100:00100000:0.0:1789081665.889301:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081665.889676:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff5dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821292416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789081665.889712:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821292928 00000100:00100000:0.0:1789081665.889715:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821292928 00000100:00100000:0.0:1789081665.889750:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789081665.889757:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d11ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875987821292672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081665.889802:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d11ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875987821292672:12345-0@lo:400:kworker.0 Request processed in 45us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081665.889809:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789081665.889822:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789081665.889829:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11006a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875987821292928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081665.889859:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11006a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875987821292928:12345-0@lo:400:kworker.0 Request processed in 31us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081665.889864:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789081665.889904:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d11ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875987821292928:0@lo:400:kworker.0 00000100:00080000:0.0:1789081665.889920:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789081665.889995:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875987821292672:0@lo:400:kworker.0 00000100:00100000:0.0:1789081665.890615:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821292544 00000100:00100000:0.0:1789081665.890621:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821292544 00000100:00100000:0.0:1789081665.890654:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1789081665.890662:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3305:x1875987821292544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081665.890709:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3305:x1875987821292544:12345-0@lo:400:kworker.0 Request processed in 48us (1406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081665.890716:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1789081665.890757:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821292544:0@lo:400:kworker.0 00000100:00100000:1.0:1789081665.892352:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789081665.892364:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d11fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875987821292800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081665.892437:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d11fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875987821292800:12345-0@lo:400:kworker.0 Request processed in 76us (3518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081665.892444:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:0.0:1789081665.892499:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789081665.892567:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d11fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875987821292800:0@lo:400:kworker.0 00010000:00010000:1.0:1789081666.337016:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081666.523898:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081666.523935:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081666.523968:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081666.523999:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796092032 00000100:00100000:3.0:1789081666.524009:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796092032 00000100:00100000:3.0:1789081666.524084:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796092160 00000100:00100000:3.0:1789081666.524088:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796092160 00000100:00100000:3.0:1789081666.524111:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 134 00000100:00100000:3.0:1789081666.524120:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c8a1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+5:2351:x1875987796092032:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081666.524193:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c8a1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+5:2351:x1875987796092032:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 73us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081666.524201:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 134 00000100:00100000:3.0:1789081666.524232:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 135 00000100:00100000:3.0:1789081666.524239:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c8a1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03f7db20-3934-4266-b84f-346a4ea22636+5:2351:x1875987796092160:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081666.524265:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c8a1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03f7db20-3934-4266-b84f-346a4ea22636+5:2351:x1875987796092160:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 26us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081666.524272:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 135 00000100:00080000:3.0:1789081666.524291:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789081666.524849:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796091904 00000100:00100000:1.0:1789081666.524856:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796091904 00000100:00100000:1.0:1789081666.524896:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 286 00000100:00100000:1.0:1789081666.524903:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2351:x1875987796091904:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:1.0:1789081666.524939:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2351:x1875987796091904:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 36us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081666.524946:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 286 00010000:00010000:1.0:1789081667.356812:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081668.392074:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789081668.648987:0:11703:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 19:07:46 (1789081666) 00010000:00010000:1.0:1789081669.405417:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081670.429930:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789081670.492973:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789081670.492997:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821293056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789081670.493072:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081670.493483:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821293056 00000100:00100000:0.0:1789081670.493493:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821293056 00000100:00100000:0.0:1789081670.493598:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1789081670.493693:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789081670.493866:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2def800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821293056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789081670.493903:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789081670.493974:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2def800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821293056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 367us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081670.493982:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1789081670.494072:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10ff5de300 x1875987821293056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081686 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789081670.494093:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821293056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789081671.005251:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d11fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821293184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789081671.005328:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081671.005589:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c8a1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875987821293568:0@lo:400:kworker.0 00000100:00100000:3.0:1789081671.005620:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081671.005641:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789081671.005646:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c8a1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875987821293440:0@lo:400:kworker.0 00000100:00100000:3.0:1789081671.005667:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081671.005696:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821293568 00000100:00100000:3.0:1789081671.005704:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821293568 00000100:00100000:3.0:1789081671.005756:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821293440 00000100:00100000:3.0:1789081671.005759:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821293440 00000100:00100000:3.0:1789081671.005780:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789081671.005801:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c8a1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875987821293568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081671.005851:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c8a1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875987821293568:12345-0@lo:400:kworker.0 Request processed in 63us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081671.005875:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789081671.005892:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789081671.005897:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c8a1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875987821293440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081671.006237:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c8a1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875987821293440:12345-0@lo:400:kworker.0 Request processed in 30us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081671.006246:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:3.0:1789081671.006272:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789081671.006304:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c8a1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875987821293440:0@lo:400:kworker.0 00000100:00100000:3.0:1789081671.006316:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c8a1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875987821293568:0@lo:400:kworker.0 00000100:00100000:0.0:1789081671.006404:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c8a1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875987821293696:0@lo:400:kworker.0 00000100:00100000:0.0:1789081671.006433:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081671.006481:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789081671.006488:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c8a1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee551687-7675-4fc6-9be1-2ccb62bdd809:3303:1875987821293312:0@lo:400:kworker.0 00000100:00100000:0.0:1789081671.006555:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081671.006595:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821293312 00000100:00100000:0.0:1789081671.006600:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821293312 00000100:00100000:0.0:1789081671.006632:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1789081671.006639:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0fd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3303:x1875987821293312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081671.006678:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0fd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3303:x1875987821293312:12345-0@lo:400:kworker.0 Request processed in 40us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081671.006685:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1789081671.006718:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c8a1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee551687-7675-4fc6-9be1-2ccb62bdd809:3303:1875987821293312:0@lo:400:kworker.0 00000100:00100000:1.0:1789081671.007140:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821293184 00000100:00100000:1.0:1789081671.007146:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821293184 00000100:00100000:1.0:1789081671.007200:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789081671.007208:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff5dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821293184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789081671.007239:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789081671.007279:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff5dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821293184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (1951us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081671.007298:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789081671.007365:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821293696 00000100:00100000:3.0:1789081671.007369:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821293696 00000100:00100000:3.0:1789081671.007407:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789081671.007415:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff5dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875987821293696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081671.007459:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff5dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875987821293696:12345-0@lo:400:kworker.0 Request processed in 44us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081671.007465:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:2.0:1789081671.007560:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789081671.007565:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789081671.007771:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c8a1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875987821293696:0@lo:400:kworker.0 00000100:00100000:0.0:1789081671.007802:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d11fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821293184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789081671.185103:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081671.185424:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796092288 00000100:00100000:3.0:1789081671.185435:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796092288 00000100:00100000:3.0:1789081671.185725:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 32 00000100:00100000:3.0:1789081671.185739:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d11fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+5:10218:x1875987796092288:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789081671.185776:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081671.185909:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d5f9a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a85e expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081671.186050:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5f9ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081671.186078:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5f9ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081671.186092:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5f9ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789081671.186297:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1789081671.186302:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789081671.186396:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5f9ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081671.186422:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d5f9a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a85e expref: 7 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081671.186441:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5f9ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a85e expref: 6 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081671.186449:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10d046f200) 00010000:00010000:3.0:1789081671.186453:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789081671.186456:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101999e00, rc 0) 00000100:00080000:2.0:1789081671.186621:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789081671.189035:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d11fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+6:10218:x1875987796092288:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 3288us (3931us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081671.189047:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 32 00000100:00100000:0.0:1789081671.207144:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081671.207234:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796092416 00000100:00100000:2.0:1789081671.207245:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796092416 00000100:00100000:2.0:1789081671.207308:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 33 00000100:00100000:2.0:1789081671.207318:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff5de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+6:10219:x1875987796092416:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789081671.207340:0:9245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081671.207362:0:9245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d5f9b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a865 expref: -99 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081671.208883:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774200/0xb7cb3d7479d5f9b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081671.208909:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774200/0xb7cb3d7479d5f9b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081671.208922:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774200/0xb7cb3d7479d5f9b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081671.208940:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d5f9c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081671.208947:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d5f9c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081671.208955:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d5f9c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081671.209394:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775800/0xb7cb3d7479d5f9c7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081671.209405:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775800/0xb7cb3d7479d5f9c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081671.209413:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775800/0xb7cb3d7479d5f9c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789081671.211151:0:9245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1789081671.211162:0:9245:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1789081671.211269:0:9245:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775800/0xb7cb3d7479d5f9c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081671.211296:0:9245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774200/0xb7cb3d7479d5f9b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081671.211302:0:9245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774200/0xb7cb3d7479d5f9b9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081671.211309:0:9245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774200/0xb7cb3d7479d5f9b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081671.211315:0:9245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101774200 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081671.211319:0:9245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774200/0xb7cb3d7479d5f9b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081671.211327:0:9245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774200/0xb7cb3d7479d5f9b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081671.211340:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10d046f200) 00010000:00010000:2.0:1789081671.211342:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081671.211347:0:9245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774200/0xb7cb3d7479d5f9b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081671.211352:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774200/0xb7cb3d7479d5f9b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081671.211364:0:9245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d5f9c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081671.211370:0:9245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d5f9c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081671.211376:0:9245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d5f9c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081671.211386:0:9245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101774600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081671.211389:0:9245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d5f9c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081671.211394:0:9245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d5f9c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081671.211402:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9e10c9a92800) 00010000:00010000:2.0:1789081671.211404:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081671.211407:0:9245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d5f9c0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081671.211412:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d5f9c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081671.211465:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d5f9b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a865 expref: 8 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081671.211479:0:9245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775800/0xb7cb3d7479d5f9c7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a865 expref: 7 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081671.211486:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e10c9a92a00) 00010000:00010000:2.0:1789081671.211488:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789081671.211491:0:9245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101775800, rc 0) 00000100:00100000:2.0:1789081671.213801:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff5de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+7:10219:x1875987796092416:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 6467us (6661us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081671.213816:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 33 00000100:00100000:1.0:1789081671.224052:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081671.224143:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796092672 00000100:00100000:3.0:1789081671.224154:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796092672 00000100:00100000:3.0:1789081671.224223:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 34 00000100:00100000:3.0:1789081671.224233:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d11ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+7:10219:x1875987796092672:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789081671.224254:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081671.224306:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d5f9ce lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a86c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081671.224380:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5f9d5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081671.224394:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5f9d5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081671.224405:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5f9d5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081671.224455:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5f9dc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081671.224462:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5f9dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081671.224468:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5f9dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081671.224995:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998a00/0xb7cb3d7479d5f9e3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081671.225007:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998a00/0xb7cb3d7479d5f9e3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081671.225015:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998a00/0xb7cb3d7479d5f9e3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789081671.225025:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1789081671.225242:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5f9d5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081671.225260:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5f9d5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081671.225266:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5f9d5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081671.225272:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998e00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081671.225276:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5f9d5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081671.225283:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5f9d5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081671.225296:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e10c9a92a00) 00010000:00010000:3.0:1789081671.225299:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081671.225303:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5f9d5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081671.225309:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5f9d5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081671.225322:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5f9dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081671.225328:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5f9dc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081671.225333:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5f9dc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081671.225337:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998000 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081671.225346:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5f9dc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081671.225352:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5f9dc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081671.225359:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e10d046f700) 00010000:00010000:3.0:1789081671.225362:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081671.225364:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5f9dc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081671.225369:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5f9dc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081671.225891:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d5f9ce lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a86c expref: 10 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081671.225917:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998a00/0xb7cb3d7479d5f9e3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a86c expref: 9 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081671.225925:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e10d046fc00) 00010000:00010000:2.0:1789081671.225928:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081671.225930:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101998a00, rc 0) 00000100:00100000:2.0:1789081671.226001:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d11ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+9:10219:x1875987796092672:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 1769us (1960us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789081671.226010:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 34 00000100:00100000:0.0:1789081671.243017:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081671.243189:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796092800 00000100:00100000:3.0:1789081671.243201:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796092800 00000100:00100000:3.0:1789081671.243397:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 35 00000100:00100000:3.0:1789081671.243409:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1100640000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+9:10219:x1875987796092800:12345-192.168.201.17@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789081671.248341:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1100640000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+9:10219:x1875987796092800:12345-192.168.201.17@tcp:59:lhsmtool_posix.0 Request processed in 4921us (5321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081671.248358:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 35 00010000:00010000:1.0:1789081671.452865:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789081671.462396:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789081671.639989:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081671.640041:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081671.640113:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796092928 00000100:00100000:1.0:1789081671.640133:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796092928 00000100:00100000:1.0:1789081671.640192:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 288 00000100:00100000:1.0:1789081671.640202:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2348:x1875987796092928:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:1.0:1789081671.640283:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2348:x1875987796092928:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 82us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081671.640291:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 288 00000100:00100000:2.0:1789081671.640553:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796093056 00000100:00100000:2.0:1789081671.640558:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796093056 00000100:00100000:2.0:1789081671.640605:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 139 00000100:00100000:2.0:1789081671.640613:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c8a1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03f7db20-3934-4266-b84f-346a4ea22636+5:2349:x1875987796093056:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:2.0:1789081671.640652:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c8a1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03f7db20-3934-4266-b84f-346a4ea22636+5:2349:x1875987796093056:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 39us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081671.640659:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 139 00000100:00080000:1.0:1789081671.640745:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789081672.484886:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081673.500742:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081673.689839:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081673.689952:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796093184 00000100:00100000:0.0:1789081673.689965:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796093184 00000100:00100000:0.0:1789081673.690057:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 36 00000100:00100000:0.0:1789081673.690069:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c8a1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+9:10261:x1875987796093184:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:0.0:1789081673.690106:0:7252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081673.690137:0:7252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5f9f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a873 expref: -99 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.690219:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5f9f8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.690260:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5f9f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.690288:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5f9f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.690304:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5f9ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.690311:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5f9ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.690317:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5f9ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.690908:0:7252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5f9f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.690919:0:7252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5f9f8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.690926:0:7252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5f9f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.690933:0:7252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101982e00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081673.690938:0:7252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5f9f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.690946:0:7252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5f9f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.690960:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10d046f200) 00010000:00010000:0.0:1789081673.690969:0:7252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081673.690976:0:7252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5f9f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.690984:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5f9f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.691000:0:7252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5f9ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.691006:0:7252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5f9ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.691011:0:7252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5f9ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.691016:0:7252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101982000 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081673.691018:0:7252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5f9ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.691023:0:7252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5f9ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.691030:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9e10d19d3e00) 00010000:00010000:0.0:1789081673.691033:0:7252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081673.691035:0:7252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5f9ff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.691040:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5f9ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.691093:0:7252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5f9f1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a873 expref: 10 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.691118:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10d046f200) 00010000:00010000:0.0:1789081673.691120:0:7252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081673.691124:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5f9f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a873 expref: 10 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.691133:0:7252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101983400, rc 0) 00000100:00100000:0.0:1789081673.691228:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c8a1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+9:10261:x1875987796093184:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 1160us (1402us total) trans 0 rc 301/301 00000100:00100000:0.0:1789081673.691236:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 36 00000100:00080000:3.0:1789081673.691592:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789081673.696203:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081673.697363:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796093440 00000100:00100000:2.0:1789081673.697381:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796093440 00000100:00100000:2.0:1789081673.697454:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 37 00000100:00100000:2.0:1789081673.697469:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c8a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+9:10261:x1875987796093440:12345-192.168.201.17@tcp:36:lfs.0 00010000:00010000:2.0:1789081673.697561:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789081673.697591:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5f9ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a85e expref: 9 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.697611:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10d046f200) 00010000:00010000:2.0:1789081673.697630:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789081673.697894:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fa06 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.697908:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fa06 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.697919:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fa06 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.697931:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d5fa0d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.697938:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d5fa0d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.697946:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d5fa0d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789081673.699171:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1789081673.699184:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fa06 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.699193:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fa06 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.699200:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fa06 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.699206:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101774a00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081673.699210:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fa06 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.699756:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fa06 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.699772:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c9a92000) 00010000:00010000:2.0:1789081673.699774:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081673.699779:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fa06 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.699785:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fa06 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789081673.699802:0:5790:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000ff7985c reply state 000000005efcc60e transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d5fa0d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081673.699811:0:5790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789081673.699932:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c8a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+10:10261:x1875987796093440:12345-192.168.201.17@tcp:36:lfs.0 Request processed in 2465us (4550us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789081673.699942:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 37 00010000:00010000:2.0:1789081673.701558:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d5fa0d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.701571:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d5fa0d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.701578:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d5fa0d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.701584:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101774000 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081673.701588:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d5fa0d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.701607:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d5fa0d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.701621:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9e10c9a92500) 00010000:00010000:2.0:1789081673.701624:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081673.701628:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d5fa0d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.701634:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d5fa0d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081673.838853:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081673.843123:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796093568 00000100:00100000:2.0:1789081673.843140:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796093568 00000100:00100000:2.0:1789081673.844327:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 38 00000100:00100000:2.0:1789081673.844343:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1100642d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+9:10269:x1875987796093568:12345-192.168.201.17@tcp:101:lctl.0 00010000:00010000:2.0:1789081673.844369:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081673.844391:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fa14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a87a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.844455:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774e00/0xb7cb3d7479d5fa1b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.844469:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774e00/0xb7cb3d7479d5fa1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.844481:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774e00/0xb7cb3d7479d5fa1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789081673.844560:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1789081673.844578:0:5789:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1789081673.844624:0:5789:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774e00/0xb7cb3d7479d5fa1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.844648:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fa14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a87a expref: 11 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.844667:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774e00/0xb7cb3d7479d5fa1b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a87a expref: 10 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.844675:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c9a92500) 00010000:00010000:2.0:1789081673.844678:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789081673.844681:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101774e00, rc 0) 00000100:00100000:2.0:1789081673.844750:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1100642d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+10:10269:x1875987796093568:12345-192.168.201.17@tcp:101:lctl.0 Request processed in 413us (5906us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081673.844757:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 38 00000100:00100000:3.0:1789081673.910343:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081673.910506:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796093696 00000100:00100000:0.0:1789081673.910516:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796093696 00000100:00100000:0.0:1789081673.913236:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 39 00000100:00100000:0.0:1789081673.913258:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c8a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+10:10275:x1875987796093696:12345-192.168.201.17@tcp:101:bash.0 00010000:00010000:0.0:1789081673.913279:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081673.913300:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5fa22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a881 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.913362:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fa29 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.913375:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fa29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.913385:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fa29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.913416:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fa30 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.913423:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fa30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.913429:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fa30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.913561:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982a00/0xb7cb3d7479d5fa37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.913570:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982a00/0xb7cb3d7479d5fa37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.913576:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982a00/0xb7cb3d7479d5fa37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789081673.913608:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1789081673.913611:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789081673.913649:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982a00/0xb7cb3d7479d5fa37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.913660:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fa29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.913666:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fa29 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.913674:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fa29 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.913690:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101982000 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081673.913694:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fa29 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.913702:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fa29 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.913714:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c9a92500) 00010000:00010000:0.0:1789081673.913717:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081673.913722:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fa29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.913728:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fa29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.913742:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fa30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.913747:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fa30 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.913752:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fa30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.913756:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101982e00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081673.913758:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fa30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.913764:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fa30 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.913781:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9e10d19d3e00) 00010000:00010000:0.0:1789081673.913783:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081673.913786:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fa30 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.913791:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fa30 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.913821:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5fa22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a881 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.913834:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982a00/0xb7cb3d7479d5fa37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a881 expref: 11 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.913842:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e10d19d3a00) 00010000:00010000:0.0:1789081673.913844:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789081673.913846:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101982a00, rc 0) 00000100:00100000:0.0:1789081673.913922:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c8a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+11:10275:x1875987796093696:12345-192.168.201.17@tcp:101:bash.0 Request processed in 672us (3588us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081673.913930:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 39 00000100:00100000:0.0:1789081673.920576:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081673.923559:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796093952 00000100:00100000:2.0:1789081673.923575:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796093952 00000100:00100000:2.0:1789081673.923642:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 40 00000100:00100000:2.0:1789081673.923653:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1100643800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+11:10275:x1875987796093952:12345-192.168.201.17@tcp:101:bash.0 00010000:00010000:2.0:1789081673.923674:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081673.923696:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fa3e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a888 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.923833:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d5fa45 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.923847:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d5fa45 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.923878:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d5fa45 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.928089:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d5fa4c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.928117:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d5fa4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.928132:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d5fa4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789081673.929778:0:5790:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1789081673.930040:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d5fa53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.930054:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d5fa53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.930065:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d5fa53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.930112:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d5fa45 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.930119:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d5fa45 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.930126:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d5fa45 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.930132:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101775000 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081673.930143:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d5fa45 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.930152:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d5fa45 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.930164:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e10d19d3a00) 00010000:00010000:2.0:1789081673.930168:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081673.930172:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d5fa45 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.930178:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d5fa45 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789081673.930191:0:5790:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f1089488 reply state 00000000c353c55d transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d5fa4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081673.930201:0:5790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789081673.930239:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fa3e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a888 expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.930255:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d5fa53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a888 expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.930263:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10c9a92600) 00010000:00010000:2.0:1789081673.930265:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789081673.930268:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101775600, rc 0) 00000100:00100000:2.0:1789081673.930413:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1100643800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+14:10275:x1875987796093952:12345-192.168.201.17@tcp:101:bash.0 Request processed in 6762us (9845us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789081673.930421:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 40 00010000:00010000:2.0:1789081673.931869:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d5fa4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.931891:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d5fa4c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.931898:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d5fa4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.931905:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101774400 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081673.931909:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d5fa4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.931916:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d5fa4c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.931942:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e10c9a92000) 00010000:00010000:2.0:1789081673.931946:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081673.931950:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d5fa4c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.931956:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d5fa4c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081673.935006:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081673.935401:0:7788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796094080 00000100:00100000:1.0:1789081673.935412:0:7788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796094080 00000100:00100000:1.0:1789081673.935461:0:7788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 20 00000100:00100000:1.0:1789081673.935469:0:7788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1100640700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2347:x1875987796094080:12345-192.168.201.17@tcp:8:bash.0 00010000:00080000:1.0:1789081673.935498:0:7788:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 41476931-e751-413e-b98c-64d4d0edcd05@192.168.201.17@tcp t0 exp 0000000000000000 cur 340 last 0 00000020:00000080:1.0:1789081673.935706:0:7788:0:(genops.c:1406:class_connect()) connect: client 41476931-e751-413e-b98c-64d4d0edcd05, cookie 0xb7cb3d7479d5fa61 00002000:00100000:1.0:1789081673.935718:0:7788:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 41476931-e751-413e-b98c-64d4d0edcd05/ffff9e10f5c2f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113719 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789081673.935740:0:7788:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789081673.936027:0:7788:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789081673.936058:0:7788:0:(import.c:65:import_set_state_nolock()) ffff9e10f5c29000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789081673.936222:0:7788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1100640700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41476931-e751-413e-b98c-64d4d0edcd05+6:2347:x1875987796094080:12345-192.168.201.17@tcp:8:bash.0 Request processed in 751us (1225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081673.936244:0:7788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 20 00000100:00100000:3.0:1789081673.942827:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081673.944984:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796094208 00000100:00100000:0.0:1789081673.945000:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796094208 00000100:00100000:0.0:1789081673.946612:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 21 00000100:00100000:0.0:1789081673.946625:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c8a1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+6:0:x1875987796094208:12345-192.168.201.17@tcp:101:bash.0 00010000:00010000:0.0:1789081673.946641:0:6584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081673.946673:0:6584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c88e852/0xb7cb3d7479d5fa68 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a88f expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789081673.946705:0:6584:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789081673.946721:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=340s v=(0 0) 00010000:00010000:0.0:1789081673.946726:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789081673.946733:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c88e852/0xb7cb3d7479d5fa68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a88f expref: 7 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.946748:0:6584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002c88e852/0xb7cb3d7479d5fa68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a88f expref: 7 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.946758:0:6584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101983400, rc 0) 00000100:00100000:0.0:1789081673.946810:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c8a1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+7:0:x1875987796094208:12345-192.168.201.17@tcp:101:bash.0 Request processed in 189us (3991us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081673.946815:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 21 00000100:00080000:1.0:1789081673.950428:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789081673.958836:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081673.959234:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796094336 00000100:00100000:0.0:1789081673.959246:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796094336 00000100:00100000:0.0:1789081673.959307:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 22 00000100:00100000:0.0:1789081673.959317:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c8a1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41476931-e751-413e-b98c-64d4d0edcd05+7:10275:x1875987796094336:12345-192.168.201.17@tcp:101:bash.0 00010000:00010000:0.0:1789081673.959333:0:6582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081673.959351:0:6582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c994970d/0xb7cb3d7479d5fa6f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a896 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.959383:0:6582:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002c88e852/0xb7cb3d7479d5fa68 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a88f expref: 8 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.959411:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789081673.959415:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789081673.959421:0:6582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c994970d/0xb7cb3d7479d5fa6f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a896 expref: 8 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.959454:0:6582:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002c88e852/0xb7cb3d7479d5fa68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a88f expref: 8 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.959468:0:6582:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002c88e852/0xb7cb3d7479d5fa68 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a88f expref: 8 pid: 6584 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081673.959482:0:6582:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1100643100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6582:1875987821293824:192.168.201.17@tcp:104: 00000100:00100000:0.0:1789081673.959607:0:6582:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10f5dfa600 going to sleep for 11 seconds 00000100:00100000:0.0:1789081673.962454:0:6582:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1100643100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6582:1875987821293824:192.168.201.17@tcp:104: 00010000:00010000:0.0:1789081673.962491:0:6582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c994970d/0xb7cb3d7479d5fa6f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a896 expref: 8 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081673.962511:0:6582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101982e00, rc 0) 00000100:00100000:0.0:1789081673.962597:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c8a1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41476931-e751-413e-b98c-64d4d0edcd05+8:10275:x1875987796094336:12345-192.168.201.17@tcp:101:bash.0 Request processed in 3281us (3771us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081673.962606:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 22 00000100:00100000:3.0:1789081673.967459:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081673.967627:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796094464 00000100:00100000:2.0:1789081673.967638:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796094464 00010000:00010000:2.0:1789081673.967683:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002c88e852/0xb7cb3d7479d5fa68 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a88f expref: 8 pid: 6584 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081673.967741:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 35 00000100:00100000:2.0:1789081673.967753:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c8a1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41476931-e751-413e-b98c-64d4d0edcd05+8:2350:x1875987796094464:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789081673.967784:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789081673.967807:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002c88e852/0xb7cb3d7479d5fa68 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a88f expref: 8 pid: 6584 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.967822:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002c88e852/0xb7cb3d7479d5fa68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a88f expref: 8 pid: 6584 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.967850:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c88e852/0xb7cb3d7479d5fa68 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a88f expref: 8 pid: 6584 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.967869:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789081673.967874:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789081673.967896:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c994970d/0xb7cb3d7479d5fa6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a896 expref: 7 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.967907:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c994970d/0xb7cb3d7479d5fa6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a896 expref: 7 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081673.967945:0:5775:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c994970d/0xb7cb3d7479d5fa6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a896 expref: 7 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081673.967960:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2ded880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5775:1875987821293952:192.168.201.17@tcp:105: 00000100:00100000:2.0:1789081673.968049:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c9167e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789081673.978036:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081673.978171:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2ded880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5775:1875987821293952:192.168.201.17@tcp:105: 00010000:00010000:2.0:1789081673.978197:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789081673.978286:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c8a1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41476931-e751-413e-b98c-64d4d0edcd05+7:2350:x1875987796094464:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 10527us (10828us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081673.978297:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 35 00000100:00100000:1.0:1789081673.982155:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796094720 00000100:00100000:1.0:1789081673.982172:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796094720 00000100:00100000:0.0:1789081673.982360:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 6 00000100:00100000:0.0:1789081673.982372:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c8a1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+13:10275:x1875987796094720:12345-192.168.201.17@tcp:35:bash.0 00000001:00080000:0.0:1789081673.982948:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967312 00000100:00100000:0.0:1789081673.983868:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c8a1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+15:10275:x1875987796094720:12345-192.168.201.17@tcp:35:bash.0 Request processed in 1491us (5834us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1789081673.983893:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 6 00000020:00080000:0.0:1789081673.983899:0:5793:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789081674.105695:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081674.106092:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796094976 00000100:00100000:1.0:1789081674.106104:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796094976 00000100:00100000:1.0:1789081674.106161:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 41 00000100:00100000:1.0:1789081674.106171:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c8a1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+15:10285:x1875987796094976:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:1.0:1789081674.106196:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081674.106217:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d5fa76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a89d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789081674.106444:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1789081674.106713:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d5fa76 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a89d expref: 17 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081674.106728:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c9a92500) 00010000:00010000:1.0:1789081674.106731:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789081674.106736:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d5fa76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a89d expref: 17 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081674.106750:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13ae600, rc 0) 00000100:00100000:1.0:1789081674.106817:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c8a1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+16:10285:x1875987796094976:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 647us (1132us total) trans 4294967314 rc 301/301 00000100:00100000:1.0:1789081674.106825:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 41 00000100:00100000:2.0:1789081674.115769:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081674.115802:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796095232 00000100:00100000:2.0:1789081674.115812:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796095232 00000100:00100000:2.0:1789081674.115861:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 7 00000100:00100000:2.0:1789081674.115870:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+16:10285:x1875987796095232:12345-192.168.201.17@tcp:35:lfs.0 00000100:00100000:2.0:1789081674.116272:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+17:10285:x1875987796095232:12345-192.168.201.17@tcp:35:lfs.0 Request processed in 401us (509us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789081674.116293:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 7 00000001:00080000:1.0:1789081674.144449:0:5811:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967313 is committed 00000100:00100000:0.0:1789081674.208918:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081674.208969:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796095360 00000100:00100000:1.0:1789081674.208992:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796095360 00000100:00100000:1.0:1789081674.209050:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 42 00000100:00100000:1.0:1789081674.209060:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1100643100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+12:10291:x1875987796095360:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:1.0:1789081674.209092:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081674.209114:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d5fa84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a8a4 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081674.209193:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5fa8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081674.209204:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5fa8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081674.209213:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5fa8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789081674.209362:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1789081674.209365:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1789081674.209415:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5fa8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081674.209435:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d5fa84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8a4 expref: 14 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081674.209448:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5fa8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8a4 expref: 13 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081674.209454:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e10d19d3a00) 00010000:00010000:1.0:1789081674.209456:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789081674.209459:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13aee00, rc 0) 00000100:00100000:1.0:1789081674.209561:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1100643100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+13:10291:x1875987796095360:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 463us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081674.209569:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 42 00000100:00100000:2.0:1789081674.229410:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081674.229692:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796095616 00000100:00100000:3.0:1789081674.229702:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796095616 00000100:00100000:3.0:1789081674.229812:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 43 00000100:00100000:3.0:1789081674.229822:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+13:10291:x1875987796095616:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:3.0:1789081674.229843:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081674.229867:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fa92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a8ab expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081674.229983:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5fa99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081674.229997:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5fa99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081674.230009:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5fa99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789081674.230020:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789081674.230414:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fa92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8ab expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081674.230434:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5fa99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8ab expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081674.230443:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10c9a92600) 00010000:00010000:3.0:1789081674.230458:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789081674.230462:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101998e00, rc 0) 00000100:00100000:3.0:1789081674.230619:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+15:10291:x1875987796095616:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 798us (1217us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789081674.230628:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 43 00000100:00100000:2.0:1789081674.235860:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081674.236649:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796095872 00000100:00100000:0.0:1789081674.236663:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796095872 00000100:00100000:0.0:1789081674.236758:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 44 00000100:00100000:0.0:1789081674.236769:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+15:10291:x1875987796095872:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:0.0:1789081674.236795:0:9245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081674.236817:0:9245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5faa7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a8b2 expref: -99 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.236929:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d5faae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.236951:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d5faae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.236962:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d5faae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789081674.236974:0:9245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789081674.237370:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5faa7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8b2 expref: 18 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.237388:0:9245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d5faae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8b2 expref: 17 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.237418:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10c9a92600) 00010000:00010000:0.0:1789081674.237420:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789081674.237423:0:9245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101983600, rc 0) 00000100:00100000:0.0:1789081674.237493:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+17:10291:x1875987796095872:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 726us (1642us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1789081674.237501:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 44 00000100:00100000:1.0:1789081674.242248:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081674.243008:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796096000 00000100:00100000:3.0:1789081674.243019:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796096000 00000100:00100000:3.0:1789081674.243345:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 2 00000100:00100000:3.0:1789081674.243355:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d11fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41476931-e751-413e-b98c-64d4d0edcd05+17:2351:x1875987796096000:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789081674.243372:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081674.243395:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5fa99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8ab expref: 17 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081674.243413:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10c9a92600) 00010000:00010000:3.0:1789081674.243418:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789081674.243477:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d11fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41476931-e751-413e-b98c-64d4d0edcd05+16:2351:x1875987796096000:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 123us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081674.243485:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 2 00000100:00100000:1.0:1789081674.259169:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081674.259281:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796096128 00000100:00100000:0.0:1789081674.259292:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796096128 00000100:00100000:0.0:1789081674.259353:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 23 00000100:00100000:0.0:1789081674.259363:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d11fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+7:2349:x1875987796096128:12345-192.168.201.17@tcp:1:lfs.0 00010000:00010000:0.0:1789081674.259410:0:6584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b202316/0xb7cb3d7479d5fabc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.259431:0:6584:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c994970d/0xb7cb3d7479d5fa6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a896 expref: 7 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.259440:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789081674.259445:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789081674.259450:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b202316/0xb7cb3d7479d5fabc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.259488:0:6584:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c994970d/0xb7cb3d7479d5fa6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a896 expref: 7 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.259503:0:6584:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c994970d/0xb7cb3d7479d5fa6f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a896 expref: 7 pid: 6582 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081674.259572:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1100641f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6584:1875987821294080:192.168.201.17@tcp:104: 00000100:00100000:0.0:1789081674.259669:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10f5dfa240 going to sleep for 11 seconds 00000100:00100000:0.0:1789081674.263772:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1100641f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6584:1875987821294080:192.168.201.17@tcp:104: 00010000:00010000:0.0:1789081674.263802:0:6584:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001b202316/0xb7cb3d7479d5fabc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081674.267448:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081674.267644:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796096256 00000100:00100000:0.0:1789081674.267655:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796096256 00002000:00100000:0.0:1789081674.267701:0:6587:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9e10d11fd500 x1875987796096256/t0(0) o4->41476931-e751-413e-b98c-64d4d0edcd05@192.168.201.17@tcp:465/0 lens 504/0 e 0 to 0 dl 1789081685 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789081674.267712:0:6587:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e10d11fd500 with x1875987796096256 ext(0->12) 00010000:00010000:0.0:1789081674.267722:0:6587:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c994970d/0xb7cb3d7479d5fa6f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a896 expref: 8 pid: 6582 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.267739:0:6587:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c994970d/0xb7cb3d7479d5fa6f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a896 expref: 8 pid: 6582 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789081674.267747:0:6587:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9e10d11fd500 00000100:00100000:0.0:1789081674.267782:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 0 00000100:00100000:0.0:1789081674.267792:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d11fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41476931-e751-413e-b98c-64d4d0edcd05+8:2350:x1875987796096256:12345-192.168.201.17@tcp:4:lfs.0 00000001:00100000:3.0:1789081674.325452:0:6607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 41476931-e751-413e-b98c-64d4d0edcd05 00000001:00080000:3.0:1789081674.395462:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:0.0:1789081674.395783:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d11fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41476931-e751-413e-b98c-64d4d0edcd05+7:2350:x1875987796096256:12345-192.168.201.17@tcp:4:lfs.0 Request processed in 127985us (128337us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789081674.395796:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 0 00002000:00100000:0.0:1789081674.395821:0:6587:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9e10d11fd500 x1875987796096256/t4294967299(0) o4->41476931-e751-413e-b98c-64d4d0edcd05@192.168.201.17@tcp:465/0 lens 504/448 e 0 to 0 dl 1789081685 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789081674.395832:0:6587:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e10d11fd500 with x1875987796096256 ext(0->12) 00010000:00010000:0.0:1789081674.395842:0:6587:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c994970d/0xb7cb3d7479d5fa6f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a896 expref: 7 pid: 6582 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.395862:0:6587:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c994970d/0xb7cb3d7479d5fa6f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a896 expref: 7 pid: 6582 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789081674.395880:0:6587:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9e10d11fd500 00000100:00100000:1.0:1789081674.402624:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081674.403581:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796096384 00000100:00100000:2.0:1789081674.403592:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796096384 00010000:00010000:2.0:1789081674.403636:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c994970d/0xb7cb3d7479d5fa6f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a896 expref: 7 pid: 6582 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081674.403682:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 36 00000100:00100000:2.0:1789081674.403692:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d11ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41476931-e751-413e-b98c-64d4d0edcd05+7:2350:x1875987796096384:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789081674.403707:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789081674.403727:0:7481:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789081674.403731:0:7481:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789081674 00002000:00010000:2.0:1789081674.403733:0:7481:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789081674 00002000:00010000:2.0:1789081674.403735:0:7481:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789081674 00002000:00010000:2.0:1789081674.403737:0:7481:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1789081674.403744:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c994970d/0xb7cb3d7479d5fa6f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a896 expref: 7 pid: 6582 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081674.403773:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c994970d/0xb7cb3d7479d5fa6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a896 expref: 7 pid: 6582 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081674.403801:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c994970d/0xb7cb3d7479d5fa6f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a896 expref: 7 pid: 6582 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081674.403819:0:7481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789081674.403824:0:7481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789081674.403830:0:7481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001b202316/0xb7cb3d7479d5fabc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081674.403840:0:7481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b202316/0xb7cb3d7479d5fabc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081674.404000:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789081674.404060:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d11ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41476931-e751-413e-b98c-64d4d0edcd05+6:2350:x1875987796096384:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 369us (1446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081674.404078:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 36 00010000:00010000:0.0:1789081674.404150:0:6584:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001b202316/0xb7cb3d7479d5fabc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.404160:0:6584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b202316/0xb7cb3d7479d5fabc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.404183:0:6584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b202316/0xb7cb3d7479d5fabc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.404192:0:6584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b202316/0xb7cb3d7479d5fabc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.404199:0:6584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b202316/0xb7cb3d7479d5fabc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.404206:0:6584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101982200 already unused, calling callback (ffffffffc1784220) 00010000:00010000:0.0:1789081674.404218:0:6584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b202316/0xb7cb3d7479d5fabc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.404228:0:6584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b202316/0xb7cb3d7479d5fabc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.404240:0:6584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b202316/0xb7cb3d7479d5fabc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.404247:0:6584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b202316/0xb7cb3d7479d5fabc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081674.404294:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d11fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+5:2349:x1875987796096128:12345-192.168.201.17@tcp:1:lfs.0 Request processed in 144931us (145137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081674.404302:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 23 00000100:00100000:2.0:1789081674.417160:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081674.417235:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796096640 00000100:00100000:3.0:1789081674.417244:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796096640 00000100:00100000:3.0:1789081674.417290:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 8 00000100:00100000:3.0:1789081674.417297:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+16:10291:x1875987796096640:12345-192.168.201.17@tcp:35:lfs.0 00000004:00010000:3.0:1789081674.417348:0:5792:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d5faae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8b2 expref: 16 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789081674.417658:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1789081674.417689:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:3.0:1789081674.418279:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00010000:00010000:3.0:1789081674.418325:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5fac3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081674.418337:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d5fa53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a888 expref: 20 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081674.418344:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5fac3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081674.418371:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d5fa53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a888 expref: 20 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081674.418383:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d5fa53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a888 expref: 20 pid: 5790 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081674.418393:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c8a1f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5792:1875987821294208:192.168.201.17@tcp:104: 00000100:00100000:3.0:1789081674.418484:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d0f9ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789081674.424882:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081674.424958:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796096768 00000100:00100000:2.0:1789081674.424966:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796096768 00010000:00010000:2.0:1789081674.425003:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d5fa53 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a888 expref: 21 pid: 5790 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081674.425051:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 37 00000100:00100000:2.0:1789081674.425060:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d11fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41476931-e751-413e-b98c-64d4d0edcd05+21:2351:x1875987796096768:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789081674.425101:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789081674.425109:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d5fa53 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a888 expref: 21 pid: 5790 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081674.425122:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d5fa53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a888 expref: 21 pid: 5790 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081674.425145:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10c9a92600) 00010000:00010000:2.0:1789081674.425151:0:5774:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5fac3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081674.425160:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5fac3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081674.425168:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5fac3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081674.425199:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789081674.425260:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d11fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41476931-e751-413e-b98c-64d4d0edcd05+21:2351:x1875987796096768:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 201us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081674.425268:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 37 00010000:00010000:3.0:1789081674.426016:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d5fa53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a888 expref: 20 pid: 5790 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081674.426036:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c8a1f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5792:1875987821294208:192.168.201.17@tcp:104: 00010000:00010000:3.0:1789081674.426060:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5fac3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081674.426095:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5fac3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081674.426101:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5fac3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789081674.426248:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000001:00080000:3.0:1789081674.426419:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1789081674.426621:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c8a1f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5792:1875987821294336:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789081674.426668:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081674.426695:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d0f9cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789081674.426828:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821294336 00000100:00100000:2.0:1789081674.426833:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821294336 00000100:00100000:2.0:1789081674.426879:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789081674.426885:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c8a1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5792:x1875987821294336:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789081674.426943:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c8a1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5792:x1875987821294336:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 59us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081674.426949:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789081674.426983:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c8a1f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5792:1875987821294336:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789081674.427503:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1789081674.427593:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dec000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5792:1875987821294464:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789081674.427628:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081674.427641:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c923f900 going to sleep for 11 seconds 00000100:00100000:2.0:1789081674.427652:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821294464 00000100:00100000:2.0:1789081674.427654:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821294464 00000100:00100000:2.0:1789081674.427671:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789081674.427675:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5792:x1875987821294464:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789081674.427813:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5792:x1875987821294464:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 137us (184us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789081674.427818:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789081674.427843:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dec000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5792:1875987821294464:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789081674.427999:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1789081674.428034:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5fac3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081674.428043:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5fac3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081674.428049:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5fac3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081674.428055:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998e00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081674.428059:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5fac3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081674.428077:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5fac3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081674.428099:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10c9a92600) 00010000:00010000:2.0:1789081674.428101:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789081674.428106:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5fac3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081674.428113:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5fac3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789081674.428431:0:5792:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789081674.428759:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1789081674.428770:0:5792:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 341311245507ns, next at 342311243532ns, rc = 0 00000001:00080000:2.0:1789081674.428776:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1789081674.428804:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10c9a92600) 00010000:00010000:2.0:1789081674.428806:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789081674.428811:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d5faae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8b2 expref: 24 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081674.428997:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+23:10291:x1875987796096640:12345-192.168.201.17@tcp:35:lfs.0 Request processed in 11694us (11841us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1789081674.429004:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 8 00000020:00080000:2.0:1789081674.429009:0:5792:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:3.0:1789081674.429104:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789081674.441505:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081674.455717:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796096896 00000100:00100000:0.0:1789081674.455734:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796096896 00000100:00100000:0.0:1789081674.455806:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 45 00000100:00100000:0.0:1789081674.455816:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d11fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+23:10291:x1875987796096896:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:0.0:1789081674.455840:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081674.455865:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983a00/0xb7cb3d7479d5faca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a8b9 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.455930:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983a00/0xb7cb3d7479d5faca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8b9 expref: 24 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.455948:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983a00/0xb7cb3d7479d5faca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8b9 expref: 24 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.455983:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10d19d3e00) 00010000:00010000:0.0:1789081674.455986:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789081674.455990:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101983a00, rc 0) 00000100:00100000:0.0:1789081674.456059:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d11fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+24:10291:x1875987796096896:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 245us (14569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081674.456095:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 45 00000100:00100000:0.0:1789081674.462662:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081674.462789:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796097152 00000100:00100000:2.0:1789081674.462802:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796097152 00000100:00100000:2.0:1789081674.462868:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 9 00000100:00100000:2.0:1789081674.462879:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b65850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+24:10291:x1875987796097152:12345-192.168.201.17@tcp:35:lfs.0 00000100:00100000:2.0:1789081674.463162:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b65850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+25:10291:x1875987796097152:12345-192.168.201.17@tcp:35:lfs.0 Request processed in 283us (509us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1789081674.463199:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 9 00010000:00010000:3.0:1789081674.526597:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789081674.577363:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081674.577481:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796097408 00000100:00100000:3.0:1789081674.577497:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796097408 00000100:00100000:3.0:1789081674.577624:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 46 00000100:00100000:3.0:1789081674.577636:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+25:10301:x1875987796097408:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:3.0:1789081674.577670:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081674.577710:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fad1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a8c0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789081674.578100:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1789081674.578305:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fad1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8c0 expref: 27 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081674.578323:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c9a92500) 00010000:00010000:3.0:1789081674.578327:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789081674.578341:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fad1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8c0 expref: 27 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081674.578358:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101998000, rc 0) 00000100:00100000:3.0:1789081674.578459:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+26:10301:x1875987796097408:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 826us (1104us total) trans 4294967328 rc 301/301 00000100:00100000:3.0:1789081674.578467:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 46 00000100:00100000:1.0:1789081674.583131:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081674.583620:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796097536 00000100:00100000:0.0:1789081674.583634:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796097536 00000100:00100000:0.0:1789081674.583719:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 47 00000100:00100000:0.0:1789081674.583731:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d11fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+26:10301:x1875987796097536:12345-192.168.201.17@tcp:34:lfs.0 00010000:00010000:0.0:1789081674.583846:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d5fadf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.583879:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d5fadf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.583894:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d5fadf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.583912:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fae6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.583919:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fae6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.583926:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fae6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.584343:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5faed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.584353:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5faed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.584360:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5faed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789081674.584760:0:9245:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5faed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.584777:0:9245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d5fadf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.584785:0:9245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d5fadf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.584793:0:9245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d5fadf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.584800:0:9245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101982400 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081674.584805:0:9245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d5fadf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.584814:0:9245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d5fadf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.584829:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e10d19d3a00) 00010000:00010000:0.0:1789081674.584833:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081674.584838:0:9245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d5fadf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.584853:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d5fadf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.584881:0:9245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fae6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.584887:0:9245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fae6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.584894:0:9245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fae6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.584899:0:9245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101983000 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081674.584903:0:9245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fae6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.584909:0:9245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fae6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.584917:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e10d19d3000) 00010000:00010000:0.0:1789081674.584920:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081674.584923:0:9245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fae6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.584940:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fae6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.584956:0:9245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5faed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.584963:0:9245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5faed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.584976:0:9245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5faed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.584980:0:9245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101983c00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081674.584984:0:9245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5faed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.584990:0:9245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5faed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.584998:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10d19d3e00) 00010000:00010000:0.0:1789081674.585001:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081674.585004:0:9245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5faed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.585011:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5faed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081674.585143:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d11fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+26:10301:x1875987796097536:12345-192.168.201.17@tcp:34:lfs.0 Request processed in 1409us (2023us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081674.585153:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 47 00000100:00100000:0.0:1789081674.590520:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081674.590717:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796097792 00000100:00100000:2.0:1789081674.590731:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796097792 00000100:00100000:2.0:1789081674.590831:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 10 00000100:00100000:2.0:1789081674.590845:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1100641f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+26:10301:x1875987796097792:12345-192.168.201.17@tcp:35:lfs.0 00000100:00100000:2.0:1789081674.591703:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1100641f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+27:10301:x1875987796097792:12345-192.168.201.17@tcp:35:lfs.0 Request processed in 857us (1193us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1789081674.591715:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 10 00000100:00100000:2.0:1789081674.622653:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081674.622748:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796098048 00000100:00100000:0.0:1789081674.622763:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796098048 00000100:00100000:0.0:1789081674.622838:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 48 00000100:00100000:0.0:1789081674.622850:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+27:10304:x1875987796098048:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:0.0:1789081674.622892:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081674.622918:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5faf4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a8c7 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.623027:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fafb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.623042:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fafb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.623052:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fafb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.623074:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d5fb02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.623079:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d5fb02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.623085:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d5fb02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.623481:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5fb09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.623490:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5fb09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.623494:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5fb09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789081674.623504:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789081674.623658:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fafb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.623665:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fafb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.623675:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fafb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.623680:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101983000 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081674.623683:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fafb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.623690:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fafb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.623702:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e10d19d3a00) 00010000:00010000:0.0:1789081674.623705:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081674.623708:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fafb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.623713:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fafb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.623723:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d5fb02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.623726:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d5fb02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.623730:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d5fb02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.623733:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101982400 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081674.623735:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d5fb02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.623746:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d5fb02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.623754:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e10d19d3000) 00010000:00010000:0.0:1789081674.623757:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081674.623760:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d5fb02 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.623765:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d5fb02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.623819:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5faf4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8c7 expref: 30 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.623833:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5fb09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8c7 expref: 29 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.623839:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10d19d3e00) 00010000:00010000:0.0:1789081674.623841:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789081674.623842:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101982200, rc 0) 00000100:00100000:0.0:1789081674.623923:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+29:10304:x1875987796098048:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 1076us (1286us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1789081674.623930:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 48 00000100:00100000:1.0:1789081674.627385:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081674.627473:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796098176 00000100:00100000:0.0:1789081674.627488:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796098176 00000100:00100000:0.0:1789081674.627812:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 49 00000100:00100000:0.0:1789081674.627826:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d11fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+29:10304:x1875987796098176:12345-192.168.201.17@tcp:54:lfs.0 00010000:00010000:0.0:1789081674.627961:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d5fb17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.627984:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d5fb17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.627998:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d5fb17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.628033:0:7252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d5fb17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.628040:0:7252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d5fb17 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.628047:0:7252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d5fb17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.628054:0:7252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101983600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081674.628059:0:7252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d5fb17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.628079:0:7252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d5fb17 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.628094:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10d19d3e00) 00010000:00010000:0.0:1789081674.628098:0:7252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789081674.628103:0:7252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d5fb17 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.628109:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d5fb17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081674.628237:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d11fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+29:10304:x1875987796098176:12345-192.168.201.17@tcp:54:lfs.0 Request processed in 413us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081674.628246:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 49 00000100:00100000:2.0:1789081674.630283:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081674.630381:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796098432 00000100:00100000:3.0:1789081674.630395:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796098432 00000100:00100000:3.0:1789081674.630467:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 11 00000100:00100000:3.0:1789081674.630480:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+29:10304:x1875987796098432:12345-192.168.201.17@tcp:35:lfs.0 00000100:00100000:3.0:1789081674.631051:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+30:10304:x1875987796098432:12345-192.168.201.17@tcp:35:lfs.0 Request processed in 571us (780us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1789081674.631076:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 11 00000100:00100000:3.0:1789081674.871437:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081674.871710:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796098688 00000100:00100000:0.0:1789081674.871724:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796098688 00000100:00100000:0.0:1789081674.871824:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 50 00000100:00100000:0.0:1789081674.871836:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c8a1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+30:10336:x1875987796098688:12345-192.168.201.17@tcp:101:cat.0 00010000:00010000:0.0:1789081674.871874:0:9245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081674.871908:0:9245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d5fb1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a8ce expref: -99 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.872077:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5fb25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.872097:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5fb25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.872112:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5fb25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789081674.872127:0:9245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789081674.872315:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d5fb1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8ce expref: 33 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.872340:0:9245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5fb25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8ce expref: 32 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.872350:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10d19d3e00) 00010000:00010000:0.0:1789081674.872367:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789081674.872372:0:9245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101983c00, rc 0) 00000100:00100000:0.0:1789081674.872457:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c8a1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+32:10336:x1875987796098688:12345-192.168.201.17@tcp:101:cat.0 Request processed in 623us (1036us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1789081674.872466:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 50 00000100:00100000:1.0:1789081674.879989:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081674.880227:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796098944 00000100:00100000:2.0:1789081674.880240:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796098944 00000100:00100000:2.0:1789081674.880320:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 12 00000100:00100000:2.0:1789081674.880332:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d11fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+32:10336:x1875987796098944:12345-192.168.201.17@tcp:35:cat.0 00000100:00100000:2.0:1789081674.880770:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d11fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+33:10336:x1875987796098944:12345-192.168.201.17@tcp:35:cat.0 Request processed in 438us (794us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1789081674.880779:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 12 00000100:00100000:2.0:1789081674.882054:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081674.887051:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796099072 00000100:00100000:3.0:1789081674.887082:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796099072 00000100:00100000:3.0:1789081674.887268:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 3 00000100:00100000:3.0:1789081674.887281:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c9388450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41476931-e751-413e-b98c-64d4d0edcd05+33:2351:x1875987796099072:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789081674.887303:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081674.887339:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5fb25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8ce expref: 33 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081674.887364:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10d19d3e00) 00010000:00010000:3.0:1789081674.887370:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789081674.887461:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c9388450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41476931-e751-413e-b98c-64d4d0edcd05+32:2351:x1875987796099072:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 183us (5415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081674.887494:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 3 00000100:00100000:0.0:1789081674.930963:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081674.931979:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796099328 00000100:00100000:3.0:1789081674.931997:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796099328 00000100:00100000:3.0:1789081674.932095:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 51 00000100:00100000:3.0:1789081674.932108:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1100641880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+32:10342:x1875987796099328:12345-192.168.201.17@tcp:101:dd.0 00010000:00010000:3.0:1789081674.932143:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081674.932147:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789081674.932324:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5fa8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8a4 expref: 32 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081674.932347:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e10d19d3a00) 00010000:00010000:3.0:1789081674.932353:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789081674.932372:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fb33 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a8d5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081674.932503:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d5fb3a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081674.932520:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5fb09 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8c7 expref: 32 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081674.932715:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d5fb3a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081674.932772:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5fb09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8c7 expref: 32 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081674.932788:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5fb09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8c7 expref: 32 pid: 5791 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081674.932824:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c8a1d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5790:1875987821294592:192.168.201.17@tcp:104: 00000100:00100000:3.0:1789081674.932972:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d0f9c840 going to sleep for 11 seconds 00000100:00100000:1.0:1789081674.939369:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081674.939953:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c8a1d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5790:1875987821294592:192.168.201.17@tcp:104: 00000100:00100000:2.0:1789081674.939975:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796099456 00000100:00100000:2.0:1789081674.939986:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796099456 00010000:00010000:3.0:1789081674.940000:0:5790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d5fb3a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081674.940040:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5fb09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8c7 expref: 33 pid: 5791 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081674.940089:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 38 00000100:00100000:2.0:1789081674.940101:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d11fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41476931-e751-413e-b98c-64d4d0edcd05+33:2350:x1875987796099456:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789081674.940143:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789081674.940152:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5fb09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8c7 expref: 33 pid: 5791 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081674.940165:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5fb09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8c7 expref: 33 pid: 5791 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081674.940196:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5fb09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8c7 expref: 33 pid: 5791 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081674.940215:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10d19d3e00) 00010000:00010000:2.0:1789081674.940220:0:5774:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d5fb3a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081674.940245:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d5fb3a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081674.940254:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d5fb3a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081674.940282:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789081674.940303:0:5790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d5fb3a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081674.940310:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d5fb3a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789081674.940334:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00000100:00100000:2.0:1789081674.940357:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d11fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41476931-e751-413e-b98c-64d4d0edcd05+32:2350:x1875987796099456:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 257us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081674.940365:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 38 00010000:00010000:3.0:1789081674.941414:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fb33 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8d5 expref: 33 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081674.941443:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d5fb3a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8d5 expref: 32 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081674.941452:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10d19d3e00) 00010000:00010000:3.0:1789081674.941454:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789081674.941457:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101999600, rc 0) 00000100:00100000:3.0:1789081674.941520:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1100641880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+32:10342:x1875987796099328:12345-192.168.201.17@tcp:101:dd.0 Request processed in 9414us (10571us total) trans 4294967334 rc 0/0 00000100:00100000:3.0:1789081674.941549:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 51 00000100:00100000:1.0:1789081674.943208:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081674.943338:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796099712 00000100:00100000:0.0:1789081674.943351:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796099712 00000100:00100000:0.0:1789081674.943468:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 52 00000100:00100000:0.0:1789081674.943480:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d11fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+32:10342:x1875987796099712:12345-192.168.201.17@tcp:36:dd.0 00010000:00010000:0.0:1789081674.944129:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fb48 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.944154:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fb48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.944170:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fb48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789081674.944238:0:7252:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967335 00000004:00010000:0.0:1789081674.944267:0:7252:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b0622758 reply state 00000000ccde6eb2 transno 4294967336 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fb48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081674.944278:0:7252:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789081674.944576:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d11fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+35:10342:x1875987796099712:12345-192.168.201.17@tcp:36:dd.0 Request processed in 1094us (1372us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1789081674.944583:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 52 00000020:00080000:0.0:1789081674.944589:0:7252:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789081674.946997:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fb48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.947043:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fb48 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.947051:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fb48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.947068:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101983000 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081674.947075:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fb48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.947082:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fb48 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.947104:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10d19d3e00) 00010000:00010000:0.0:1789081674.947107:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081674.947112:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fb48 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081674.947119:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fb48 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081675.257364:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081675.257505:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796099840 00000100:00100000:0.0:1789081675.257519:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796099840 00000100:00080000:3.0:1789081675.257658:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789081675.257673:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 53 00000100:00100000:0.0:1789081675.257687:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d11fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+34:10356:x1875987796099840:12345-192.168.201.17@tcp:101:stat.0 00010000:00010000:0.0:1789081675.257721:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081675.257761:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fb4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a8dc expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.257874:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fb56 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.257900:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fb56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.257916:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fb56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.257933:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fb5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.257940:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fb5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.257946:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fb5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.258326:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d5fb64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.258339:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d5fb3a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8d5 expref: 35 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.258348:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d5fb64 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.258393:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d5fb3a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8d5 expref: 35 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.258411:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d5fb3a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8d5 expref: 35 pid: 5790 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081675.258447:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1100643480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5791:1875987821294720:192.168.201.17@tcp:104: 00000100:00100000:0.0:1789081675.258613:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10f5dfa9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789081675.264323:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081675.264439:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796100096 00000100:00100000:3.0:1789081675.264453:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796100096 00000100:00100000:3.0:1789081675.264564:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 13 00000100:00100000:3.0:1789081675.264576:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+36:5566:x1875987796100096:12345-192.168.201.17@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789081675.265125:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+37:5566:x1875987796100096:12345-192.168.201.17@tcp:35:ldlm_bl.0 Request processed in 550us (815us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1789081675.265137:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 13 00000100:00100000:0.0:1789081675.267278:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1100643480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5791:1875987821294720:192.168.201.17@tcp:104: 00010000:00010000:0.0:1789081675.267323:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d5fb64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081675.273963:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081675.274162:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796100224 00000100:00100000:2.0:1789081675.274176:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796100224 00010000:00010000:2.0:1789081675.274233:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d5fb3a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8d5 expref: 37 pid: 5790 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081675.274307:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 39 00000100:00100000:2.0:1789081675.274319:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c8a1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41476931-e751-413e-b98c-64d4d0edcd05+37:2351:x1875987796100224:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789081675.274339:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789081675.274348:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d5fb3a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8d5 expref: 37 pid: 5790 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.274362:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d5fb3a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8d5 expref: 37 pid: 5790 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.274393:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d5fb3a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8d5 expref: 37 pid: 5790 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.274413:0:7481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10d19d3e00) 00010000:00010000:2.0:1789081675.274420:0:7481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d5fb64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.274432:0:7481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d5fb64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.274441:0:7481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d5fb64 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.274480:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789081675.274613:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c8a1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41476931-e751-413e-b98c-64d4d0edcd05+36:2351:x1875987796100224:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 296us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081675.274622:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 39 00010000:00010000:0.0:1789081675.275043:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d5fb64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.275065:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d5fb64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789081675.275128:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789081675.275133:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789081675.275210:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d5fb64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.275228:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d5fb64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.275240:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fb56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.275248:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fb56 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.275255:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fb56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.275263:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101982e00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081675.275275:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fb56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.275284:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fb56 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.275295:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e10d19d3a00) 00010000:00010000:0.0:1789081675.275298:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081675.275302:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fb56 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.275309:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fb56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.275322:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fb5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.275328:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fb5d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.275333:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fb5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.275338:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101982600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081675.275341:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fb5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.275346:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fb5d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.275354:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e10d19d3000) 00010000:00010000:0.0:1789081675.275356:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081675.275366:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fb5d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.275373:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fb5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.275421:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fb4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8dc expref: 36 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.275437:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d5fb64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8dc expref: 35 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.275444:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10d19d3e00) 00010000:00010000:0.0:1789081675.275446:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789081675.275449:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101983800, rc 0) 00000100:00100000:0.0:1789081675.275746:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d11fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+35:10356:x1875987796099840:12345-192.168.201.17@tcp:101:stat.0 Request processed in 18060us (18392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081675.275757:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 53 00000100:00100000:3.0:1789081675.375880:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081675.376016:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796100480 00000100:00100000:2.0:1789081675.376057:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796100480 00000100:00100000:2.0:1789081675.376139:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 54 00000100:00100000:2.0:1789081675.376150:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c8a1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+35:10362:x1875987796100480:12345-192.168.201.17@tcp:36:truncate.0 00010000:00010000:2.0:1789081675.376231:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789081675.376271:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d5fb64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8dc expref: 35 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.376295:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10d19d3e00) 00010000:00010000:2.0:1789081675.376301:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789081675.376669:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d5fb6b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.376687:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d5fb6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.376699:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d5fb6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789081675.376759:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967338 00000004:00010000:2.0:1789081675.376789:0:5790:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009da740bf reply state 0000000088ce9e5c transno 4294967339 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d5fb6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081675.376800:0:5790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789081675.376953:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c8a1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+37:10362:x1875987796100480:12345-192.168.201.17@tcp:36:truncate.0 Request processed in 803us (1101us total) trans 4294967339 rc 0/0 00000100:00100000:2.0:1789081675.376962:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 54 00000020:00080000:2.0:1789081675.376970:0:5790:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789081675.382361:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d5fb6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.382388:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d5fb6b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.382422:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d5fb6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.382429:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101775600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081675.382435:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d5fb6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.382443:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d5fb6b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.382466:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10d19d3e00) 00010000:00010000:2.0:1789081675.382470:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081675.382475:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d5fb6b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.382482:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d5fb6b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.548874:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789081675.549482:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789081675.553787:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081675.553871:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796100608 00000100:00100000:0.0:1789081675.553884:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796100608 00000100:00100000:0.0:1789081675.554039:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 55 00000100:00100000:0.0:1789081675.554064:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff700000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+36:10376:x1875987796100608:12345-192.168.201.17@tcp:101:stat.0 00010000:00010000:0.0:1789081675.554102:0:7252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081675.554135:0:7252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fb72 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a8e3 expref: -99 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.554651:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fb79 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.554685:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fb79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.554700:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fb79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.554719:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fb80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.554726:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fb80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.554732:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fb80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.555169:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5fb87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.555180:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5fb87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.555188:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5fb87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789081675.555701:0:7252:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1789081675.555709:0:7252:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789081675.555740:0:7252:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5fb87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.555758:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5fb87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.555782:0:7252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fb79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.555789:0:7252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fb79 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.555797:0:7252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fb79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.555803:0:7252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101982600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081675.555808:0:7252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fb79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.555816:0:7252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fb79 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.555831:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e10d19d3a00) 00010000:00010000:0.0:1789081675.555833:0:7252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081675.555839:0:7252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fb79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.555845:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fb79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.555859:0:7252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fb80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.555866:0:7252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fb80 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.555871:0:7252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fb80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.555882:0:7252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101982e00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081675.555885:0:7252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fb80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.555890:0:7252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fb80 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.555897:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e10d19d3000) 00010000:00010000:0.0:1789081675.555900:0:7252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081675.555903:0:7252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fb80 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.555908:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fb80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.555952:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fb72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8e3 expref: 38 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.555967:0:7252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5fb87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8e3 expref: 37 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.555974:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10d19d3e00) 00010000:00010000:0.0:1789081675.555976:0:7252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789081675.555979:0:7252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101983400, rc 0) 00000100:00100000:0.0:1789081675.556685:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff700000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+37:10376:x1875987796100608:12345-192.168.201.17@tcp:101:stat.0 Request processed in 2621us (2909us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081675.556696:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 55 00000004:00080000:0.0:1789081675.616098:0:6651:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 342498570432ns, next at 343498567227ns, rc = 0 00000100:00100000:1.0:1789081675.616825:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789081675.616860:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1100643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821294848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789081675.616959:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081675.617249:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821294848 00000100:00100000:0.0:1789081675.617259:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821294848 00000100:00100000:0.0:1789081675.617330:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789081675.617341:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d11ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875987821294848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789081675.617389:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789081675.617470:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d11ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875987821294848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081675.617479:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789081675.617921:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1100643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821294848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789081675.674182:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081675.674486:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796100864 00000100:00100000:0.0:1789081675.674502:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796100864 00000100:00100000:0.0:1789081675.674637:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 56 00000100:00100000:0.0:1789081675.674652:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d11fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+37:10386:x1875987796100864:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:0.0:1789081675.674701:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081675.674734:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fb8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a8ea expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789081675.675335:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1789081675.675610:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fb8e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8ea expref: 39 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.675631:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c9a92500) 00010000:00010000:0.0:1789081675.675635:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789081675.675641:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fb8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8ea expref: 39 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.676318:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101983000, rc 0) 00000100:00100000:2.0:1789081675.676946:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d11fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+38:10386:x1875987796100864:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 2291us (2773us total) trans 4294967340 rc 301/301 00000100:00100000:2.0:1789081675.676959:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 56 00000100:00100000:3.0:1789081675.683859:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081675.684136:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796101120 00000100:00100000:2.0:1789081675.684150:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796101120 00000100:00100000:2.0:1789081675.684238:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 14 00000100:00100000:2.0:1789081675.684252:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff700380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+38:10386:x1875987796101120:12345-192.168.201.17@tcp:35:lfs.0 00000100:00100000:2.0:1789081675.685099:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff700380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+39:10386:x1875987796101120:12345-192.168.201.17@tcp:35:lfs.0 Request processed in 846us (1263us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1789081675.685122:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 14 00000100:00100000:3.0:1789081675.730157:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081675.730410:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796101376 00000100:00100000:0.0:1789081675.730434:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796101376 00000100:00100000:0.0:1789081675.730636:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 57 00000100:00100000:0.0:1789081675.730648:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+39:10392:x1875987796101376:12345-192.168.201.17@tcp:101:bash.0 00010000:00010000:0.0:1789081675.730684:0:9245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081675.730715:0:9245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fb9c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a8f1 expref: -99 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.730861:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fba3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.730880:0:9245:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5fb87 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8e3 expref: 40 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.730891:0:9245:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fba3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.730933:0:9245:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5fb87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8e3 expref: 40 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.731078:0:9245:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5fb87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8e3 expref: 40 pid: 7252 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081675.731096:0:9245:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1100643480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9245:1875987821294976:192.168.201.17@tcp:104: 00000100:00100000:0.0:1789081675.731278:0:9245:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10f5dfab40 going to sleep for 11 seconds 00000100:00100000:1.0:1789081675.735028:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081675.735143:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796101504 00000100:00100000:3.0:1789081675.735157:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796101504 00010000:00010000:3.0:1789081675.735215:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5fb87 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8e3 expref: 41 pid: 7252 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081675.735283:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 40 00000100:00100000:3.0:1789081675.735295:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d11fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41476931-e751-413e-b98c-64d4d0edcd05+41:2350:x1875987796101504:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789081675.735316:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081675.735325:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5fb87 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8e3 expref: 41 pid: 7252 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.735340:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5fb87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8e3 expref: 41 pid: 7252 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.735393:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10d19d3e00) 00010000:00010000:3.0:1789081675.735400:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fba3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.735412:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fba3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.735421:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fba3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.735446:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789081675.735699:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d11fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41476931-e751-413e-b98c-64d4d0edcd05+41:2350:x1875987796101504:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 405us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081675.735708:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 40 00010000:00010000:0.0:1789081675.736183:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5fb87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8e3 expref: 40 pid: 7252 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081675.736205:0:9245:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1100643480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9245:1875987821294976:192.168.201.17@tcp:104: 00010000:00010000:0.0:1789081675.737781:0:9245:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fba3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.737806:0:9245:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fba3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.737813:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fba3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789081675.737852:0:9245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1789081675.738682:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fb9c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8f1 expref: 41 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.738709:0:9245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fba3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8f1 expref: 40 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.738719:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10d19d3e00) 00010000:00010000:0.0:1789081675.738722:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789081675.738726:0:9245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101982e00, rc 0) 00000100:00100000:0.0:1789081675.738808:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+40:10392:x1875987796101376:12345-192.168.201.17@tcp:101:bash.0 Request processed in 8161us (8663us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1789081675.738818:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 57 00000100:00100000:2.0:1789081675.747338:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081675.747442:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796101760 00000100:00100000:0.0:1789081675.747455:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796101760 00000100:00100000:0.0:1789081675.747593:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 58 00000100:00100000:0.0:1789081675.747605:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2ded500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+40:10392:x1875987796101760:12345-192.168.201.17@tcp:36:bash.0 00010000:00010000:0.0:1789081675.748479:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fbb1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.748577:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fbb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.748594:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fbb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789081675.748725:0:7252:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967343 00000004:00010000:0.0:1789081675.748758:0:7252:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005886ad35 reply state 000000000aaa374a transno 4294967344 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fbb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081675.748769:0:7252:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789081675.748954:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2ded500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+43:10392:x1875987796101760:12345-192.168.201.17@tcp:36:bash.0 Request processed in 1349us (1629us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1789081675.749085:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 58 00000020:00080000:0.0:1789081675.749092:0:7252:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789081675.753359:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fbb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.753380:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fbb1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.753389:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fbb1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.753396:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101982600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081675.753401:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fbb1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.753410:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fbb1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.753460:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10d19d3e00) 00010000:00010000:3.0:1789081675.753464:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081675.753469:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fbb1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.753475:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fbb1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081675.758918:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081675.759060:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796101888 00000100:00100000:1.0:1789081675.759076:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796101888 00000100:00100000:1.0:1789081675.759169:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 59 00000100:00100000:1.0:1789081675.759182:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+42:10392:x1875987796101888:12345-192.168.201.17@tcp:101:bash.0 00010000:00010000:1.0:1789081675.759216:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081675.759259:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5fbb8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a8f8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081675.759395:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afa00/0xb7cb3d7479d5fbbf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081675.759413:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fba3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8f1 expref: 43 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081675.759424:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afa00/0xb7cb3d7479d5fbbf lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081675.759466:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fba3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8f1 expref: 43 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081675.759481:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fba3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8f1 expref: 43 pid: 9245 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081675.759498:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d11fd180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5791:1875987821295104:192.168.201.17@tcp:104: 00000100:00100000:1.0:1789081675.759676:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c9167180 going to sleep for 11 seconds 00000100:00100000:2.0:1789081675.763601:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d11fd180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5791:1875987821295104:192.168.201.17@tcp:104: 00010000:00010000:2.0:1789081675.763648:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afa00/0xb7cb3d7479d5fbbf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081675.765346:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081675.765822:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796102016 00000100:00100000:1.0:1789081675.765835:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796102016 00010000:00010000:1.0:1789081675.765896:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fba3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8f1 expref: 44 pid: 9245 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081675.765981:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 41 00000100:00100000:1.0:1789081675.765992:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2defb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41476931-e751-413e-b98c-64d4d0edcd05+44:2351:x1875987796102016:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789081675.766013:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789081675.766021:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fba3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8f1 expref: 44 pid: 9245 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081675.766062:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fba3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8f1 expref: 44 pid: 9245 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081675.766094:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fba3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8f1 expref: 44 pid: 9245 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081675.766117:0:7481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10d19d3e00) 00010000:00010000:1.0:1789081675.766124:0:7481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afa00/0xb7cb3d7479d5fbbf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081675.766136:0:7481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afa00/0xb7cb3d7479d5fbbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081675.766146:0:7481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afa00/0xb7cb3d7479d5fbbf lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081675.766183:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789081675.766255:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2defb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41476931-e751-413e-b98c-64d4d0edcd05+43:2351:x1875987796102016:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 264us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081675.766262:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 41 00010000:00010000:2.0:1789081675.768740:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afa00/0xb7cb3d7479d5fbbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.768764:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afa00/0xb7cb3d7479d5fbbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789081675.768840:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789081675.768857:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789081675.768887:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afa00/0xb7cb3d7479d5fbbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.768942:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5fbb8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8f8 expref: 43 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.768968:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afa00/0xb7cb3d7479d5fbbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8f8 expref: 42 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.768978:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10d19d3e00) 00010000:00010000:2.0:1789081675.768981:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789081675.768985:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13afa00, rc 0) 00000100:00100000:2.0:1789081675.769123:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+42:10392:x1875987796101888:12345-192.168.201.17@tcp:101:bash.0 Request processed in 9941us (10221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081675.769133:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 59 00000100:00100000:2.0:1789081675.776399:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081675.778983:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796102272 00000100:00100000:3.0:1789081675.779007:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796102272 00000100:00100000:3.0:1789081675.779108:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 15 00000100:00100000:3.0:1789081675.779118:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b65050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+42:10392:x1875987796102272:12345-192.168.201.17@tcp:35:bash.0 00000100:00100000:3.0:1789081675.779406:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b65050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+43:10392:x1875987796102272:12345-192.168.201.17@tcp:35:bash.0 Request processed in 289us (3019us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1789081675.779411:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 15 00000100:00100000:0.0:1789081675.877450:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081675.877571:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796102528 00000100:00100000:2.0:1789081675.877584:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796102528 00000100:00100000:2.0:1789081675.877665:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 60 00000100:00100000:2.0:1789081675.877677:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1100643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+43:10402:x1875987796102528:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:2.0:1789081675.877709:0:9245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081675.877737:0:9245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d5fbc6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a8ff expref: -99 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789081675.878099:0:9245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1789081675.879432:0:9245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d5fbc6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8ff expref: 45 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.879456:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c9a92500) 00010000:00010000:2.0:1789081675.879459:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789081675.879465:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d5fbc6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8ff expref: 45 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.879483:0:9245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101775600, rc 0) 00000100:00100000:2.0:1789081675.879674:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1100643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+44:10402:x1875987796102528:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 1999us (2238us total) trans 4294967346 rc 301/301 00000100:00100000:2.0:1789081675.879684:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 60 00000100:00100000:0.0:1789081675.885943:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081675.886319:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796102656 00000100:00100000:3.0:1789081675.886333:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796102656 00000100:00100000:3.0:1789081675.886417:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 61 00000100:00100000:3.0:1789081675.886430:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1100641f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+44:10402:x1875987796102656:12345-192.168.201.17@tcp:34:lfs.0 00010000:00010000:3.0:1789081675.886588:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fbd4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.886610:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fbd4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.886625:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fbd4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.886666:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fbdb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.886675:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fbdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.886682:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fbdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.887085:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5fbe2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.887098:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5fbe2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.887105:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5fbe2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789081675.887164:0:7252:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5fbe2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.887181:0:7252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fbd4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.887188:0:7252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fbd4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.887197:0:7252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fbd4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.887204:0:7252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998000 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081675.887209:0:7252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fbd4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.887224:0:7252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fbd4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.887237:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e10d19d3a00) 00010000:00010000:3.0:1789081675.887240:0:7252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081675.887245:0:7252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fbd4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.887251:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fbd4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.887266:0:7252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fbdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.887273:0:7252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fbdb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.887279:0:7252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fbdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.887283:0:7252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999000 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081675.887286:0:7252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fbdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.887291:0:7252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fbdb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.887297:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e10d046ff00) 00010000:00010000:3.0:1789081675.887299:0:7252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081675.887302:0:7252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fbdb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.887318:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fbdb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.887333:0:7252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5fbe2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.887339:0:7252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5fbe2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.887344:0:7252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5fbe2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.887350:0:7252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999400 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081675.887353:0:7252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5fbe2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.887359:0:7252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5fbe2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.887367:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10d19d3e00) 00010000:00010000:3.0:1789081675.887369:0:7252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081675.887372:0:7252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5fbe2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.887379:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5fbe2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081675.887477:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1100641f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+44:10402:x1875987796102656:12345-192.168.201.17@tcp:34:lfs.0 Request processed in 1046us (1546us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081675.887487:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 61 00000100:00100000:3.0:1789081675.893154:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081675.893455:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796102912 00000100:00100000:0.0:1789081675.893469:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796102912 00000100:00100000:3.0:1789081675.893802:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 16 00000100:00100000:3.0:1789081675.893817:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+44:10402:x1875987796102912:12345-192.168.201.17@tcp:35:lfs.0 00000100:00100000:3.0:1789081675.895187:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+45:10402:x1875987796102912:12345-192.168.201.17@tcp:35:lfs.0 Request processed in 1363us (2035us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1789081675.895200:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 16 00000100:00100000:0.0:1789081675.929778:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081675.930061:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796103168 00000100:00100000:2.0:1789081675.930075:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796103168 00000100:00100000:2.0:1789081675.930255:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 62 00000100:00100000:2.0:1789081675.930267:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+45:10405:x1875987796103168:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:2.0:1789081675.930299:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081675.930327:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d5fbe9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a906 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.930430:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d5fbf0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.930447:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d5fbf0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.930461:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d5fbf0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.930477:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d5fbf7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.930484:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d5fbf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.930491:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d5fbf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.931081:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d5fbfe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.931094:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d5fbfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.931103:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d5fbfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789081675.931129:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789081675.931255:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d5fbf0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.931264:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d5fbf0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.931271:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d5fbf0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.931277:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101775c00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081675.931281:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d5fbf0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.931289:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d5fbf0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.931303:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e10d19d3a00) 00010000:00010000:2.0:1789081675.931306:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081675.931311:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d5fbf0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.931318:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d5fbf0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.931332:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d5fbf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.931338:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d5fbf7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.931353:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d5fbf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.931358:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101775a00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081675.931360:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d5fbf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.931366:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d5fbf7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.931373:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e10c9a92600) 00010000:00010000:2.0:1789081675.931376:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081675.931378:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d5fbf7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.931383:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d5fbf7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.931438:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d5fbe9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a906 expref: 48 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.931452:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d5fbfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a906 expref: 47 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081675.931460:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10d19d3e00) 00010000:00010000:2.0:1789081675.931462:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789081675.931464:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101775000, rc 0) 00000100:00100000:2.0:1789081675.931831:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+47:10405:x1875987796103168:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 1565us (2067us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1789081675.932621:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 62 00000100:00100000:0.0:1789081675.936512:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081675.936613:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081675.936648:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796103424 00000100:00100000:0.0:1789081675.936673:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796103424 00000100:00100000:0.0:1789081675.936755:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 4 00000100:00100000:0.0:1789081675.936767:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9484380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41476931-e751-413e-b98c-64d4d0edcd05+47:2351:x1875987796103424:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789081675.936789:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789081675.936822:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d5fbfe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a906 expref: 47 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081675.936870:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10d19d3e00) 00010000:00010000:0.0:1789081675.936876:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789081675.936944:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9484380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41476931-e751-413e-b98c-64d4d0edcd05+46:2351:x1875987796103424:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 180us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081675.936952:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 4 00000100:00100000:3.0:1789081675.937567:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796103296 00000100:00100000:3.0:1789081675.937576:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796103296 00000100:00100000:3.0:1789081675.937624:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 63 00000100:00100000:3.0:1789081675.937633:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+46:10405:x1875987796103296:12345-192.168.201.17@tcp:54:lfs.0 00010000:00010000:3.0:1789081675.937728:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5fc0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.937746:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5fc0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.937756:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5fc0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.937792:0:9245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5fc0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.937799:0:9245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5fc0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.937806:0:9245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5fc0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.937812:0:9245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999400 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081675.937817:0:9245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5fc0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.937838:0:9245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5fc0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.938358:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10d19d3e00) 00010000:00010000:3.0:1789081675.938361:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789081675.938367:0:9245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5fc0c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081675.938374:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5fc0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081675.938453:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+46:10405:x1875987796103296:12345-192.168.201.17@tcp:54:lfs.0 Request processed in 821us (1954us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081675.938462:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 63 00000100:00100000:0.0:1789081675.942389:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081675.942483:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796103680 00000100:00100000:3.0:1789081675.942496:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796103680 00000100:00100000:3.0:1789081675.942606:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 17 00000100:00100000:3.0:1789081675.942619:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+46:10405:x1875987796103680:12345-192.168.201.17@tcp:35:lfs.0 00000100:00100000:3.0:1789081675.942961:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+47:10405:x1875987796103680:12345-192.168.201.17@tcp:35:lfs.0 Request processed in 344us (586us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1789081675.942971:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 17 00000100:00100000:0.0:1789081676.077671:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081676.077782:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796103936 00000100:00100000:1.0:1789081676.077795:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796103936 00000100:00100000:1.0:1789081676.077878:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 64 00000100:00100000:1.0:1789081676.077891:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+47:10423:x1875987796103936:12345-192.168.201.17@tcp:101:cat.0 00010000:00010000:1.0:1789081676.077926:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081676.077955:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d5fc13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a90d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081676.078128:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fc1a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081676.078144:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fc1a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081676.078158:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fc1a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789081676.078173:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789081676.078597:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d5fc13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a90d expref: 50 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081676.078621:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fc1a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a90d expref: 49 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081676.078632:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10d19d3e00) 00010000:00010000:1.0:1789081676.078635:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789081676.078639:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13af400, rc 0) 00000100:00100000:1.0:1789081676.078711:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+49:10423:x1875987796103936:12345-192.168.201.17@tcp:101:cat.0 Request processed in 822us (1065us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1789081676.078719:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 64 00000100:00100000:0.0:1789081676.105280:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081676.105456:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796104064 00000100:00100000:3.0:1789081676.105471:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796104064 00000100:00100000:3.0:1789081676.105578:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 65 00000100:00100000:3.0:1789081676.105590:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+49:10424:x1875987796104064:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:3.0:1789081676.105622:0:9245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081676.105650:0:9245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5fc28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a914 expref: -99 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.105769:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fc2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.105788:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fc2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.105801:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fc2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789081676.106090:0:9245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1789081676.106095:0:9245:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789081676.106178:0:9245:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fc2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.106215:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5fc28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a914 expref: 51 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.106249:0:9245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fc2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a914 expref: 50 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.106259:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e10d19d3a00) 00010000:00010000:3.0:1789081676.106262:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789081676.106266:0:9245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101999000, rc 0) 00000100:00100000:3.0:1789081676.106353:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+50:10424:x1875987796104064:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 765us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081676.106362:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 65 00000100:00100000:0.0:1789081676.114788:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081676.114906:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796104448 00000100:00100000:3.0:1789081676.114918:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796104448 00000100:00100000:3.0:1789081676.115013:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 18 00000100:00100000:3.0:1789081676.115024:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+50:10424:x1875987796104448:12345-192.168.201.17@tcp:35:lfs.0 00000100:00100000:3.0:1789081676.115464:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+51:10424:x1875987796104448:12345-192.168.201.17@tcp:35:lfs.0 Request processed in 441us (690us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1789081676.115472:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 18 00000100:00100000:0.0:1789081676.118481:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081676.118629:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796104576 00000100:00100000:3.0:1789081676.118641:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796104576 00000100:00100000:3.0:1789081676.118729:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 5 00000100:00100000:3.0:1789081676.118741:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41476931-e751-413e-b98c-64d4d0edcd05+51:10424:x1875987796104576:12345-192.168.201.17@tcp:103:lfs.0 00010000:00010000:3.0:1789081676.118762:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789081676.118798:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afa00/0xb7cb3d7479d5fbbf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8f8 expref: 51 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.118823:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fc1a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a90d expref: 50 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.118835:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983a00/0xb7cb3d7479d5faca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a8b9 expref: 49 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.118857:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10d19d3e00) 00010000:00010000:3.0:1789081676.118870:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789081676.118942:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41476931-e751-413e-b98c-64d4d0edcd05+48:10424:x1875987796104576:12345-192.168.201.17@tcp:103:lfs.0 Request processed in 203us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081676.118951:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 5 00000100:00100000:0.0:1789081676.121851:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081676.122354:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796104704 00000100:00100000:3.0:1789081676.122369:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796104704 00000100:00100000:3.0:1789081676.122503:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 66 00000100:00100000:3.0:1789081676.122566:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+48:10424:x1875987796104704:12345-192.168.201.17@tcp:58:lfs.0 00010000:00010000:3.0:1789081676.122746:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5fc36 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.122766:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5fc36 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.122780:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5fc36 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789081676.123170:0:7252:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789081676.123737:0:7252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1789081676.123819:0:7252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1789081676.124104:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+48:10424:x1875987796104704:12345-192.168.201.17@tcp:58:lfs.0 Request processed in 1535us (2272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081676.124116:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 66 00000100:00100000:0.0:1789081676.125925:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789081676.125953:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821295232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789081676.126055:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081676.126144:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821295232 00000100:00100000:0.0:1789081676.126155:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821295232 00000100:00100000:0.0:1789081676.126222:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789081676.126231:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821295232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789081676.126274:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789081676.126322:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821295232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081676.126330:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1789081676.126352:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789081676.126393:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821295232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789081676.127015:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875987821295488:0@lo:400:kworker.0 00000100:00100000:1.0:1789081676.127073:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081676.127140:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789081676.127152:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821295360:0@lo:400:kworker.0 00000100:00100000:3.0:1789081676.127189:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081676.127242:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821295360 00000100:00100000:3.0:1789081676.127247:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821295360 00000100:00100000:3.0:1789081676.127283:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1789081676.127290:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3305:x1875987821295360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081676.127329:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3305:x1875987821295360:12345-0@lo:400:kworker.0 Request processed in 39us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081676.127337:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1789081676.127374:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821295360:0@lo:400:kworker.0 00000100:00100000:3.0:1789081676.127398:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821295488 00000100:00100000:3.0:1789081676.127417:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821295488 00000100:00100000:3.0:1789081676.127445:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789081676.127451:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d11ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875987821295488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789081676.127558:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875987821295616:0@lo:400:kworker.0 00000100:00100000:2.0:1789081676.127592:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081676.127628:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821295616 00000100:00100000:2.0:1789081676.127632:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821295616 00000100:00080000:2.0:1789081676.127669:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789081676.127700:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789081676.127708:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875987821295616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789081676.127744:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875987821295616:12345-0@lo:400:kworker.0 Request processed in 37us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081676.127751:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789081676.127777:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875987821295616:0@lo:400:kworker.0 00000100:00100000:3.0:1789081676.138469:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d11ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875987821295488:12345-0@lo:400:kworker.0 Request processed in 11002us (11380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081676.138490:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789081676.138882:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875987821295872:0@lo:400:kworker.0 00000100:00100000:2.0:1789081676.138970:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081676.139015:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789081676.139021:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821295744:0@lo:400:kworker.0 00000100:00100000:2.0:1789081676.139065:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081676.139121:0:7788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821295744 00000100:00100000:2.0:1789081676.139130:0:7788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821295744 00000100:00100000:2.0:1789081676.139192:0:7788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789081676.139202:0:7788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1875987821295744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789081676.139261:0:7788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1875987821295744:12345-0@lo:400:kworker.0 Request processed in 61us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081676.139267:0:7788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1789081676.139286:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789081676.139342:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821295744:0@lo:400:kworker.0 00000100:00100000:0.0:1789081676.139685:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821295872 00000100:00100000:0.0:1789081676.139697:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821295872 00000100:00100000:0.0:1789081676.139752:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789081676.139760:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875987821295872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081676.139805:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875987821295872:12345-0@lo:400:kworker.0 Request processed in 47us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081676.139812:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:2.0:1789081676.139951:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789081676.139975:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875987821295872:0@lo:400:kworker.0 00000100:00100000:1.0:1789081676.142029:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875987821295488:0@lo:400:kworker.0 00000100:00100000:0.0:1789081676.148744:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081676.149022:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796104832 00000100:00100000:2.0:1789081676.149045:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796104832 00000100:00100000:2.0:1789081676.149125:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 67 00000100:00100000:2.0:1789081676.149137:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+48:10426:x1875987796104832:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:2.0:1789081676.149170:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081676.149201:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d5fc3d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a91b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081676.149311:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d5fc44 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081676.149329:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d5fc44 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081676.149342:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d5fc44 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081676.149360:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d5fc4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081676.149368:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d5fc4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081676.149374:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d5fc4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081676.149798:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fc52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081676.149817:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fc52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081676.149826:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fc52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789081676.150156:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789081676.150163:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789081676.150187:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fc52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081676.150202:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fc52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081676.150212:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d5fc44 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081676.150219:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d5fc44 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081676.150237:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d5fc44 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081676.150244:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101775a00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081676.150249:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d5fc44 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081676.150257:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d5fc44 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081676.150271:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e10d19d3a00) 00010000:00010000:2.0:1789081676.150274:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081676.150286:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d5fc44 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081676.150294:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d5fc44 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081676.150311:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d5fc4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081676.150317:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d5fc4b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081676.150324:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d5fc4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081676.150330:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101775c00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081676.150333:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d5fc4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081676.150340:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d5fc4b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081676.150348:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e10c9a92600) 00010000:00010000:2.0:1789081676.150351:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081676.150355:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d5fc4b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081676.150361:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d5fc4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081676.150399:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d5fc3d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a91b expref: 50 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081676.150426:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fc52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a91b expref: 49 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081676.150433:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10d046ff00) 00010000:00010000:2.0:1789081676.150436:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789081676.150438:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101774a00, rc 0) 00000100:00100000:2.0:1789081676.150516:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+49:10426:x1875987796104832:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 1381us (1787us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081676.150583:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 67 00000040:00080000:1.0:1789081676.578389:0:11539:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789081676.578402:0:11539:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789081676.578477:0:11539:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789081676.578486:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789081676.578667:0:11539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d11fed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11539:1875987821296000:192.168.201.17@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789081676.578805:0:11539:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c9167a80 going to sleep for 11 seconds 00010000:00010000:3.0:1789081676.588133:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789081676.588412:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081676.588455:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796104960 00000100:00100000:1.0:1789081676.588468:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796104960 00000100:00100000:1.0:1789081676.588553:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 1 00000100:00100000:1.0:1789081676.588566:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d11fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:41476931-e751-413e-b98c-64d4d0edcd05+50:10437:x1875987796104960:12345-192.168.201.17@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789081676.588968:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d11fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:41476931-e751-413e-b98c-64d4d0edcd05+50:10437:x1875987796104960:12345-192.168.201.17@tcp:900:lhsmtool_posix.0 Request processed in 403us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081676.588978:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 1 00000100:00100000:3.0:1789081676.593778:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081676.593826:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796105088 00000100:00100000:3.0:1789081676.593853:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796105088 00000100:00100000:3.0:1789081676.593929:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 68 00000100:00100000:3.0:1789081676.593941:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+50:10437:x1875987796105088:12345-192.168.201.17@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789081676.593988:0:5789:0:(mdt_handler.c:8081:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789081676.594142:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+50:10437:x1875987796105088:12345-192.168.201.17@tcp:53:lhsmtool_posix.0 Request processed in 202us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081676.594151:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 68 00000100:00100000:3.0:1789081676.594331:0:11539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d11fed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11539:1875987821296000:192.168.201.17@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789081676.599583:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081676.599695:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796105216 00000100:00100000:3.0:1789081676.599710:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796105216 00000100:00100000:3.0:1789081676.599797:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 69 00000100:00100000:3.0:1789081676.599810:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d11fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+49:10437:x1875987796105216:12345-192.168.201.17@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789081676.600075:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fc59 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.600100:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fc59 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.600141:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fc59 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.600163:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d5fc60 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.600171:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d5fc60 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.600178:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d5fc60 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.600213:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fc67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.600232:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fc67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.600240:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fc67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789081676.600294:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789081676.600300:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789081676.600318:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fc67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.600330:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fc59 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.600337:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fc59 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.600356:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fc59 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.600363:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998000 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081676.600368:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fc59 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.600378:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fc59 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.600393:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e10d046fc00) 00010000:00010000:3.0:1789081676.600396:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081676.600401:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fc59 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.600409:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fc59 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.600427:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d5fc60 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.600434:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d5fc60 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.600440:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d5fc60 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.600446:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081676.600449:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d5fc60 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.600465:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d5fc60 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.600475:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9e10d046f500) 00010000:00010000:3.0:1789081676.600477:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081676.600481:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d5fc60 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.600486:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d5fc60 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.600503:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fc67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.600509:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fc67 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.600516:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fc67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.600557:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998800 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081676.600561:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fc67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.600568:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fc67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.600576:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10d046ff00) 00010000:00010000:3.0:1789081676.600578:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081676.600581:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fc67 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.600597:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fc67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081676.601391:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d11fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+49:10437:x1875987796105216:12345-192.168.201.17@tcp:34:lhsmtool_posix.0 Request processed in 1576us (1816us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081676.601405:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 69 00000100:00100000:3.0:1789081676.606013:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081676.606313:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796105472 00000100:00100000:0.0:1789081676.606327:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796105472 00000100:00100000:0.0:1789081676.606413:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 70 00000100:00100000:0.0:1789081676.606425:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+49:10437:x1875987796105472:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789081676.606456:0:9245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081676.606485:0:9245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5fc6e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a922 expref: -99 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081676.608197:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5fc75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081676.608227:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5fc75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081676.608243:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5fc75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789081676.608263:0:9245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789081676.608418:0:9245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5fc75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081676.608426:0:9245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5fc75 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081676.608433:0:9245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5fc75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081676.608448:0:9245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13afe00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081676.608453:0:9245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5fc75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081676.608462:0:9245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5fc75 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081676.608476:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10d046ff00) 00010000:00010000:1.0:1789081676.608479:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789081676.608484:0:9245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5fc75 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081676.608490:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5fc75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081676.609126:0:9245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5fc6e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a922 expref: 51 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081676.609144:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e10d046fc00) 00010000:00010000:1.0:1789081676.609147:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789081676.609151:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5fc6e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a922 expref: 51 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081676.609164:0:9245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101983400, rc 0) 00000100:00100000:1.0:1789081676.609265:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+50:10437:x1875987796105472:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 2841us (3264us total) trans 4294967352 rc 301/301 00000100:00100000:1.0:1789081676.609276:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 70 00000100:00100000:0.0:1789081676.617182:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081676.617336:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796105600 00000100:00100000:3.0:1789081676.617348:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796105600 00000100:00100000:3.0:1789081676.617423:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 71 00000100:00100000:3.0:1789081676.617435:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+50:10437:x1875987796105600:12345-192.168.201.17@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789081676.617488:0:7252:0:(mdt_handler.c:8081:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789081676.617674:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+50:10437:x1875987796105600:12345-192.168.201.17@tcp:53:lhsmtool_posix.0 Request processed in 241us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081676.617683:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 71 00000100:00100000:1.0:1789081676.625330:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081676.625740:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796105856 00000100:00100000:3.0:1789081676.625755:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796105856 00000100:00100000:3.0:1789081676.627739:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 72 00000100:00100000:3.0:1789081676.627763:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5dd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+50:10437:x1875987796105856:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789081676.627794:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081676.627798:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789081676.627842:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fc2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a914 expref: 50 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.627864:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e10d19d3a00) 00010000:00010000:3.0:1789081676.627871:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789081676.627901:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fc83 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a929 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789081676.628777:0:5790:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1789081676.629036:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d5fc8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.629055:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d5fc8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.629069:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d5fc8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.629141:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fc83 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a929 expref: 52 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.629159:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d5fc8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a929 expref: 51 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.629168:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e10d046f500) 00010000:00010000:3.0:1789081676.629171:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789081676.629174:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101998600, rc 0) 00000100:00100000:3.0:1789081676.629270:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5dd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+51:10437:x1875987796105856:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 1516us (3955us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1789081676.629279:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 72 00000100:00100000:0.0:1789081676.642760:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081676.642849:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796106112 00000100:00100000:0.0:1789081676.642864:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796106112 00000100:00100000:0.0:1789081676.642936:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 73 00000100:00100000:0.0:1789081676.642947:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+51:10437:x1875987796106112:12345-192.168.201.17@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789081676.643044:0:9245:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789081676.643083:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d5fc8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a929 expref: 51 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.643103:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e10d046f500) 00010000:00010000:0.0:1789081676.643116:0:9245:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789081676.643167:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fc98 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.643184:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fc98 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.643195:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fc98 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.647494:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fc9f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xf034999e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.647547:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fc9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf034999e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.647564:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fc9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf034999e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.648111:0:9245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fc98 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.648122:0:9245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fc98 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.648129:0:9245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fc98 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.648136:0:9245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101982e00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081676.648143:0:9245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fc98 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.648151:0:9245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fc98 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.648184:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e10d19d3a00) 00010000:00010000:0.0:1789081676.648188:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081676.648192:0:9245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fc98 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.648200:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fc98 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.648223:0:9245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fc9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf034999e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.648231:0:9245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fc9f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf034999e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.648238:0:9245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fc9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf034999e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.648247:0:9245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101982000 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081676.648252:0:9245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fc9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf034999e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.648259:0:9245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fc9f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf034999e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.648273:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xf034999e (ffff9e10d19d3000) 00010000:00010000:0.0:1789081676.648277:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081676.648280:0:9245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fc9f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf034999e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.648287:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fc9f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf034999e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081676.648458:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+50:10437:x1875987796106112:12345-192.168.201.17@tcp:36:lhsmtool_posix.0 Request processed in 5502us (5701us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789081676.648473:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 73 00000100:00100000:0.0:1789081676.651810:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081676.651878:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796106240 00000100:00100000:0.0:1789081676.651895:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796106240 00000100:00100000:0.0:1789081676.651969:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 74 00000100:00100000:0.0:1789081676.651980:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+50:10437:x1875987796106240:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789081676.652009:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081676.652052:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fca6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a930 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.652097:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fcad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.652113:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fcad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.652127:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fcad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.652267:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fca6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a930 expref: 52 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.652285:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fcad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a930 expref: 51 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.652306:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e10d19d3400) 00010000:00010000:0.0:1789081676.652309:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789081676.652313:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101982600, rc 0) 00000100:00100000:0.0:1789081676.652380:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+51:10437:x1875987796106240:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 402us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081676.652388:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 74 00000100:00100000:0.0:1789081676.662457:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081676.665794:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796106496 00000100:00100000:3.0:1789081676.665814:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796106496 00000100:00100000:3.0:1789081676.666914:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 75 00000100:00100000:3.0:1789081676.666934:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+51:10437:x1875987796106496:12345-192.168.201.17@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789081676.667092:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fcb4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.667115:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fcb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.667130:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fcb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789081676.667508:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1789081676.667549:0:5789:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 343550023974ns, next at 344549993899ns, rc = 0 00000004:00010000:3.0:1789081676.670947:0:5789:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000df7ed0d8 reply state 00000000522648ca transno 4294967354 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fcb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081676.670971:0:5789:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789081676.671180:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+53:10437:x1875987796106496:12345-192.168.201.17@tcp:36:lhsmtool_posix.0 Request processed in 4245us (8727us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1789081676.671194:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 75 00000100:00100000:3.0:1789081676.682201:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00010000:00010000:3.0:1789081676.682244:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fcb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.682259:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fcb4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.682268:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fcb4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.682276:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998800 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081676.682283:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fcb4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.682308:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fcb4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.682332:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e10d19d3400) 00010000:00010000:3.0:1789081676.682336:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789081676.682342:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fcb4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.682349:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fcb4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081676.682390:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796106624 00000100:00100000:3.0:1789081676.682404:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796106624 00000100:00100000:3.0:1789081676.682464:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 76 00000100:00100000:3.0:1789081676.682475:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+52:10437:x1875987796106624:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789081676.682507:0:9245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081676.682556:0:9245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fcbb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a937 expref: -99 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.682632:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fcbb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a937 expref: 53 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.682648:0:9245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fcbb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a937 expref: 53 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081676.682672:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e10d19d3400) 00010000:00010000:3.0:1789081676.682675:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789081676.682678:0:9245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101999000, rc 0) 00000100:00100000:3.0:1789081676.682755:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+53:10437:x1875987796106624:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 280us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081676.682762:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 76 00000100:00100000:2.0:1789081676.687715:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081676.687993:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796106752 00000100:00100000:3.0:1789081676.688007:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796106752 00000100:00100000:3.0:1789081676.688081:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 24 00000100:00100000:3.0:1789081676.688092:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2347:x1875987796106752:12345-192.168.201.17@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1789081676.688144:0:6581:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 41476931-e751-413e-b98c-64d4d0edcd05@192.168.201.17@tcp t0 exp 0000000000000000 cur 343 last 0 00000020:00000080:3.0:1789081676.688190:0:6581:0:(genops.c:1406:class_connect()) connect: client 41476931-e751-413e-b98c-64d4d0edcd05, cookie 0xb7cb3d7479d5fcc2 00002000:00100000:3.0:1789081676.688206:0:6581:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 41476931-e751-413e-b98c-64d4d0edcd05/ffff9e10f958a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113719 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789081676.688223:0:6581:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789081676.688594:0:6581:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789081676.688638:0:6581:0:(import.c:65:import_set_state_nolock()) ffff9e10f9588800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789081676.688955:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41476931-e751-413e-b98c-64d4d0edcd05+6:2347:x1875987796106752:12345-192.168.201.17@tcp:8:lhsmtool_posix.0 Request processed in 861us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081676.688967:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 24 00000100:00100000:0.0:1789081676.700012:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081676.703816:0:7788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796106880 00000100:00100000:2.0:1789081676.703910:0:7788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796106880 00000100:00100000:0.0:1789081676.709070:0:7788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 25 00000100:00100000:0.0:1789081676.709090:0:7788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41476931-e751-413e-b98c-64d4d0edcd05+6:0:x1875987796106880:12345-192.168.201.17@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1789081676.717698:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789081676.763748:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081676.763801:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081676.763850:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796107008 00000100:00100000:1.0:1789081676.763862:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796107008 00000100:00100000:3.0:1789081676.764108:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796107136 00000100:00100000:3.0:1789081676.764113:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796107136 00000100:00100000:3.0:1789081676.764170:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 45 00000100:00100000:3.0:1789081676.764182:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41476931-e751-413e-b98c-64d4d0edcd05+5:2350:x1875987796107136:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081676.764277:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41476931-e751-413e-b98c-64d4d0edcd05+5:2350:x1875987796107136:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 97us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081676.764285:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 45 00000100:00100000:1.0:1789081676.764344:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 290 00000100:00100000:1.0:1789081676.764352:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2350:x1875987796107008:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:1.0:1789081676.764380:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2350:x1875987796107008:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 30us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081676.764387:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 290 00000100:00080000:1.0:1789081676.764426:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789081676.774352:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081676.774407:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796107264 00000100:00100000:3.0:1789081676.774430:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796107264 00000100:00100000:3.0:1789081676.774508:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 143 00000100:00100000:3.0:1789081676.774520:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03f7db20-3934-4266-b84f-346a4ea22636+5:2350:x1875987796107264:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081676.776000:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03f7db20-3934-4266-b84f-346a4ea22636+5:2350:x1875987796107264:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 122us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081676.776037:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 143 00000100:00080000:3.0:1789081676.776094:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789081676.799817:0:7493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:2.0:1789081676.799852:0:7493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 41476931-e751-413e-b98c-64d4d0edcd05 00000100:00100000:1.0:1789081676.800149:0:7788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41476931-e751-413e-b98c-64d4d0edcd05+5:0:x1875987796106880:12345-192.168.201.17@tcp:2:lhsmtool_posix.0 Request processed in 91055us (100143us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789081676.800165:0:7788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 25 00000100:00100000:0.0:1789081676.805339:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081676.805864:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796107520 00000100:00100000:3.0:1789081676.805878:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796107520 00000100:00100000:3.0:1789081676.805950:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 19 00000100:00100000:3.0:1789081676.805962:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+53:10437:x1875987796107520:12345-192.168.201.17@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789081676.806311:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+54:10437:x1875987796107520:12345-192.168.201.17@tcp:35:lhsmtool_posix.0 Request processed in 349us (986us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1789081676.806320:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 19 00000100:00100000:3.0:1789081676.808494:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081676.808659:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796107776 00000100:00100000:0.0:1789081676.808672:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796107776 00000100:00100000:0.0:1789081676.808744:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 77 00000100:00100000:0.0:1789081676.808755:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+54:10437:x1875987796107776:12345-192.168.201.17@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789081676.808902:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+54:10437:x1875987796107776:12345-192.168.201.17@tcp:57:lhsmtool_posix.0 Request processed in 149us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081676.808911:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 77 00000100:00100000:3.0:1789081676.811208:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081676.811358:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796107904 00000100:00100000:0.0:1789081676.811370:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796107904 00000100:00100000:0.0:1789081676.811444:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 78 00000100:00100000:0.0:1789081676.811455:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+54:10437:x1875987796107904:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789081676.811482:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081676.811517:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fcc9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a93e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.811694:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5fcd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.811713:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5fcd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.811727:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5fcd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789081676.811778:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789081676.811803:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5fcd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.812040:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5fcc9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a93e expref: 56 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.812064:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5fcd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a93e expref: 55 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.812073:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e10d19d3400) 00010000:00010000:0.0:1789081676.812077:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789081676.812081:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101982200, rc 0) 00000100:00100000:0.0:1789081676.812195:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+55:10437:x1875987796107904:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 741us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081676.812203:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 78 00000100:00100000:3.0:1789081676.822665:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081676.822789:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796108032 00000100:00100000:1.0:1789081676.822802:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796108032 00000100:00100000:1.0:1789081676.822883:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 26 00000100:00100000:1.0:1789081676.822896:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41476931-e751-413e-b98c-64d4d0edcd05+5:2351:x1875987796108032:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789081676.822921:0:6582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081676.822950:0:6582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4df4081/0xb7cb3d7479d5fcd7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a945 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789081676.822985:0:6582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3384c, blocks: 0x1 00010000:00010000:1.0:1789081676.823010:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=343s v=(0 0) 00010000:00010000:1.0:1789081676.823016:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789081676.823038:0:6582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4df4081/0xb7cb3d7479d5fcd7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a945 expref: 6 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081676.823083:0:6582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d4df4081/0xb7cb3d7479d5fcd7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a945 expref: 6 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081676.823100:0:6582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13afa00, rc 0) 00000100:00100000:1.0:1789081676.823180:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41476931-e751-413e-b98c-64d4d0edcd05+6:2351:x1875987796108032:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 287us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081676.823187:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 26 00000100:00100000:1.0:1789081676.833348:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081676.833426:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796108288 00000100:00100000:3.0:1789081676.833439:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796108288 00000100:00100000:3.0:1789081676.833548:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 79 00000100:00100000:3.0:1789081676.833562:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+55:10437:x1875987796108288:12345-192.168.201.17@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789081676.833741:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+55:10437:x1875987796108288:12345-192.168.201.17@tcp:57:lhsmtool_posix.0 Request processed in 182us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081676.833749:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 79 00000100:00100000:3.0:1789081676.836581:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081676.836870:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796108416 00000100:00100000:0.0:1789081676.836883:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796108416 00000100:00100000:0.0:1789081676.836959:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 27 00000100:00100000:0.0:1789081676.836986:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+6:10437:x1875987796108416:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789081676.837011:0:6584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081676.837051:0:6584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c994970d/0xb7cb3d7479d5fcde lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a94c expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.837092:0:6584:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4df4081/0xb7cb3d7479d5fcd7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a945 expref: 7 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.837102:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789081676.837107:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789081676.837113:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c994970d/0xb7cb3d7479d5fcde lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a94c expref: 7 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.837160:0:6584:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d4df4081/0xb7cb3d7479d5fcd7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a945 expref: 7 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.837175:0:6584:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d4df4081/0xb7cb3d7479d5fcd7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a945 expref: 7 pid: 6582 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081676.837191:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b33100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6584:1875987821296128:192.168.201.17@tcp:104: 00000100:00100000:0.0:1789081676.837316:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c8e87b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789081676.840195:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b33100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6584:1875987821296128:192.168.201.17@tcp:104: 00010000:00010000:0.0:1789081676.840248:0:6584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c994970d/0xb7cb3d7479d5fcde lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a94c expref: 7 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.840297:0:6584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101982e00, rc 0) 00000100:00100000:0.0:1789081676.840376:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+7:10437:x1875987796108416:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 3392us (3808us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081676.840387:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 27 00000100:00100000:3.0:1789081676.857095:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081676.861712:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796108544 00000100:00100000:0.0:1789081676.861734:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796108544 00010000:00010000:0.0:1789081676.861810:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d4df4081/0xb7cb3d7479d5fcd7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a945 expref: 7 pid: 6582 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081676.861887:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 42 00000100:00100000:0.0:1789081676.861899:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c9388850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41476931-e751-413e-b98c-64d4d0edcd05+7:2350:x1875987796108544:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789081676.861924:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789081676.861956:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d4df4081/0xb7cb3d7479d5fcd7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a945 expref: 7 pid: 6582 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.861972:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d4df4081/0xb7cb3d7479d5fcd7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a945 expref: 7 pid: 6582 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.862007:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4df4081/0xb7cb3d7479d5fcd7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a945 expref: 7 pid: 6582 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.862038:0:5774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789081676.862044:0:5774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789081676.862055:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c994970d/0xb7cb3d7479d5fcde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a94c expref: 6 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.862089:0:5774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c994970d/0xb7cb3d7479d5fcde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a94c expref: 6 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081676.862148:0:5774:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c994970d/0xb7cb3d7479d5fcde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a94c expref: 6 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081676.862166:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b33100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5774:1875987821296256:192.168.201.17@tcp:105: 00000100:00100000:0.0:1789081676.862690:0:5774:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c8e87b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789081676.891271:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081676.891450:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b33100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5774:1875987821296256:192.168.201.17@tcp:105: 00010000:00010000:2.0:1789081676.891487:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789081676.891576:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c9388850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41476931-e751-413e-b98c-64d4d0edcd05+6:2350:x1875987796108544:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 29679us (34496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081676.891590:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 42 00000100:00100000:3.0:1789081676.893287:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796108672 00000100:00100000:3.0:1789081676.893306:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796108672 00002000:00100000:3.0:1789081676.893379:0:6589:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9e10f5f0d500 x1875987796108672/t0(0) o4->41476931-e751-413e-b98c-64d4d0edcd05@192.168.201.17@tcp:467/0 lens 504/0 e 0 to 0 dl 1789081687 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789081676.893394:0:6589:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e10f5f0d500 with x1875987796108672 ext(0->8) 00002000:00010000:3.0:1789081676.893400:0:6589:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e10f5f0d500 00000100:00100000:3.0:1789081676.893436:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 0 00000100:00100000:3.0:1789081676.893448:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41476931-e751-413e-b98c-64d4d0edcd05+6:2350:x1875987796108672:12345-192.168.201.17@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789081676.895247:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41476931-e751-413e-b98c-64d4d0edcd05+8:2350:x1875987796108672:12345-192.168.201.17@tcp:4:lhsmtool_posix.0 Request processed in 1791us (3980us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789081676.895261:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 0 00002000:00100000:3.0:1789081676.895274:0:6589:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9e10f5f0d500 x1875987796108672/t4294967302(0) o4->41476931-e751-413e-b98c-64d4d0edcd05@192.168.201.17@tcp:467/0 lens 504/448 e 0 to 0 dl 1789081687 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789081676.895285:0:6589:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e10f5f0d500 with x1875987796108672 ext(0->8) 00002000:00010000:3.0:1789081676.895291:0:6589:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e10f5f0d500 00000100:00100000:3.0:1789081676.904337:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081676.904368:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796108800 00000100:00100000:3.0:1789081676.904378:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796108800 00000100:00100000:3.0:1789081676.904430:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 80 00000100:00100000:3.0:1789081676.904441:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+55:10437:x1875987796108800:12345-192.168.201.17@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789081676.983595:0:5811:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967344 is committed 00000004:00080000:0.0:1789081676.983621:0:5811:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1789081676.983649:0:5811:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000004:00080000:0.0:1789081676.983677:0:5811:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:0.0:1789081676.983688:0:5811:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e10d16560c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1789081676.983693:0:5811:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e10ff771400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e10d3033600 00000020:00080000:0.0:1789081676.983697:0:5811:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e10ff771100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e10c9242400 00000001:00080000:0.0:1789081676.983712:0:5811:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967355 is committed 00000004:00080000:0.0:1789081676.983717:0:5811:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:0.0:1789081676.984313:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1b33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821296384:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789081676.984378:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081676.984439:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789081676.984444:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821296512:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789081676.984652:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081676.984943:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+13:10437:x1875987796108800:12345-192.168.201.17@tcp:44:lhsmtool_posix.0 Request processed in 78188us (78298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081676.984962:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 80 00000100:00100000:3.0:1789081676.985138:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000020:00080000:1.0:1789081676.985299:0:5822:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1789081676.987378:0:5822:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1789081676.987425:0:7788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821296384 00000100:00100000:1.0:1789081676.987438:0:7788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821296384 00000100:00100000:1.0:1789081676.987502:0:7788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821296512 00000100:00100000:1.0:1789081676.987506:0:7788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821296512 00000100:00100000:1.0:1789081676.987539:0:7788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796108928 00000100:00100000:1.0:1789081676.987543:0:7788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796108928 00000100:00100000:1.0:1789081676.987564:0:7788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789081676.987575:0:7788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1875987821296384:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789081676.987630:0:7788:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1789081676.987682:0:7788:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa3384a, atime: 0x6aa3384a, ctime: 0x6aa3384a, blocks: 0xb 00010000:00010000:1.0:1789081676.987692:0:7788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cda72b71/0xb7cb3d7479d5fce5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081676.987712:0:7788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=343s v=(0 0) 00010000:00010000:1.0:1789081676.987717:0:7788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789081676.987724:0:7788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cda72b71/0xb7cb3d7479d5fce5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081676.987761:0:7788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cda72b71/0xb7cb3d7479d5fce5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081676.987772:0:7788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cda72b71/0xb7cb3d7479d5fce5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081676.987780:0:7788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cda72b71/0xb7cb3d7479d5fce5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081676.987804:0:7788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789081676.988221:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789081676.988234:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff646680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821296512:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789081676.988389:0:6584:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789081676.988392:0:6584:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789081676 00002000:00010000:3.0:1789081676.988394:0:6584:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789081676.988397:0:6584:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789081676 -> 1789081676 00002000:00010000:3.0:1789081676.988399:0:6584:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789081676.988493:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff646680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1875987821296512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 263us (3840us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789081676.988501:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789081676.988556:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 30 00000100:00100000:3.0:1789081676.988563:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+8:2350:x1875987796108928:12345-192.168.201.17@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789081676.989466:0:7788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3303:x1875987821296384:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1888us (5082us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789081676.989477:0:7788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000004:00080000:0.0:1789081676.996830:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e10f5c7b100/2, rc 0, transno 4294967303 00000100:00100000:0.0:1789081676.996852:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821296512:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1789081676.996900:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e10d1b33100/2, rc 0, transno 4294967301 00000100:00100000:0.0:1789081676.996907:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1b33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821296384:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1789081676.997583:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789081676.997602:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cda72b71/0xb7cb3d7479d5fce5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081676.997621:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13af600 already unused, calling callback (ffffffffc1784220) 00010000:00010000:2.0:1789081676.997627:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cda72b71/0xb7cb3d7479d5fce5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081676.997663:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cda72b71/0xb7cb3d7479d5fce5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081676.997694:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cda72b71/0xb7cb3d7479d5fce5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081676.997712:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cda72b71/0xb7cb3d7479d5fce5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081676.997741:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081676.997744:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081676.997746:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789081677.061070:0:7493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:1.0:1789081677.061092:0:7493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:3.0:1789081677.062225:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+6:2350:x1875987796108928:12345-192.168.201.17@tcp:16:lhsmtool_posix.0 Request processed in 73648us (77073us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081677.062241:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 30 00000100:00100000:0.0:1789081677.071213:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081677.071334:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796109184 00000100:00100000:1.0:1789081677.071348:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796109184 00000100:00100000:1.0:1789081677.071455:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 81 00000100:00100000:1.0:1789081677.071469:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+13:10437:x1875987796109184:12345-192.168.201.17@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789081677.071580:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789081677.071617:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5fcd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a93e expref: 13 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.071638:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e10d19d3400) 00010000:00010000:1.0:1789081677.071644:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789081677.071693:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d5fcec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.071709:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d5fcec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.071721:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d5fcec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789081677.072070:0:5791:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f21ea5c3 reply state 0000000001b01651 transno 4294967356 ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d5fcec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081677.072081:0:5791:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789081677.072206:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+14:10437:x1875987796109184:12345-192.168.201.17@tcp:36:lhsmtool_posix.0 Request processed in 740us (1006us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1789081677.072214:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 81 00000100:00080000:0.0:1789081677.073042:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789081677.081302:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d5fcec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.081326:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d5fcec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.081337:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d5fcec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.081344:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13aec00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081677.081350:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d5fcec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.081361:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d5fcec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.081385:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e10d19d3400) 00010000:00010000:0.0:1789081677.081388:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081677.081393:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d5fcec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.081400:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d5fcec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081677.085861:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081677.085986:0:7788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796109312 00000100:00100000:1.0:1789081677.086000:0:7788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796109312 00000100:00100000:1.0:1789081677.086080:0:7788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 31 00000100:00100000:1.0:1789081677.086091:0:7788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff647100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41476931-e751-413e-b98c-64d4d0edcd05+6:2351:x1875987796109312:12345-192.168.201.17@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789081677.086434:0:7788:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1789081677.086439:0:7788:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789081676 -> 1789081675 00002000:00010000:1.0:1789081677.086442:0:7788:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789081674 00002000:00010000:1.0:1789081677.086445:0:7788:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789081676 -> 1789081675 00002000:00010000:1.0:1789081677.086447:0:7788:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789081677.086549:0:7788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff647100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41476931-e751-413e-b98c-64d4d0edcd05+7:2351:x1875987796109312:12345-192.168.201.17@tcp:2:lhsmtool_posix.0 Request processed in 434us (673us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789081677.086558:0:7788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 31 00000100:00100000:0.0:1789081677.095156:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081677.098680:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796109568 00000100:00100000:3.0:1789081677.098707:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796109568 00000100:00100000:3.0:1789081677.098810:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 82 00000100:00100000:3.0:1789081677.098823:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+13:10437:x1875987796109568:12345-192.168.201.17@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789081677.098920:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fcf3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.098940:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fcad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a930 expref: 13 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.098951:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fcf3 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.099029:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fcad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a930 expref: 13 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.099047:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fcad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a930 expref: 13 pid: 5791 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081677.099065:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5f0dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5789:1875987821296640:192.168.201.17@tcp:104: 00000100:00100000:3.0:1789081677.099217:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c539f840 going to sleep for 11 seconds 00000100:00100000:3.0:1789081677.105061:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5f0dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5789:1875987821296640:192.168.201.17@tcp:104: 00010000:00010000:3.0:1789081677.105106:0:5789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fcf3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081677.115738:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081677.116111:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796109696 00000100:00100000:3.0:1789081677.116126:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796109696 00010000:00010000:3.0:1789081677.116183:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fcad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a930 expref: 14 pid: 5791 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081677.116237:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 43 00000100:00100000:3.0:1789081677.116248:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff645880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41476931-e751-413e-b98c-64d4d0edcd05+14:2350:x1875987796109696:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789081677.116268:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081677.116277:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fcad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a930 expref: 14 pid: 5791 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.116293:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fcad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a930 expref: 14 pid: 5791 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.116339:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fcad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a930 expref: 14 pid: 5791 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.116356:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e10d19d3400) 00010000:00010000:3.0:1789081677.116362:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fcf3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.116374:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fcf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.116383:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fcf3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.116417:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789081677.116484:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff645880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41476931-e751-413e-b98c-64d4d0edcd05+13:2350:x1875987796109696:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 238us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081677.116493:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 43 00010000:00010000:3.0:1789081677.116565:0:5789:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fcf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.116574:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fcf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.116611:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fcf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.116619:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fcf3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.116626:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fcf3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.116639:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998800 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081677.116644:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fcf3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.116652:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fcf3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.116661:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e10d19d3400) 00010000:00010000:3.0:1789081677.116664:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789081677.116667:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fcf3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.116673:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fcf3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081677.116735:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+12:10437:x1875987796109568:12345-192.168.201.17@tcp:55:lhsmtool_posix.0 Request processed in 17915us (21594us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789081677.116746:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 82 00000100:00100000:2.0:1789081677.121809:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081677.121904:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796109824 00000100:00100000:3.0:1789081677.121915:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796109824 00000100:00100000:3.0:1789081677.121985:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 32 00000100:00100000:3.0:1789081677.121996:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c8a1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41476931-e751-413e-b98c-64d4d0edcd05+7:2349:x1875987796109824:12345-192.168.201.17@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789081677.122055:0:6582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000819e4087/0xb7cb3d7479d5fcfa lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.122076:0:6582:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c994970d/0xb7cb3d7479d5fcde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a94c expref: 7 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.122099:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789081677.122103:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789081677.122109:0:6582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000819e4087/0xb7cb3d7479d5fcfa lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.122146:0:6582:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c994970d/0xb7cb3d7479d5fcde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a94c expref: 7 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.122161:0:6582:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c994970d/0xb7cb3d7479d5fcde lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a94c expref: 7 pid: 6584 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081677.122177:0:6582:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5f0dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6582:1875987821296768:192.168.201.17@tcp:104: 00000100:00100000:3.0:1789081677.122265:0:6582:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c539f840 going to sleep for 11 seconds 00000100:00100000:3.0:1789081677.125990:0:6582:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5f0dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6582:1875987821296768:192.168.201.17@tcp:104: 00010000:00010000:3.0:1789081677.126032:0:6582:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000819e4087/0xb7cb3d7479d5fcfa lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081677.128319:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081677.128399:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796109952 00000100:00100000:0.0:1789081677.128416:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796109952 00010000:00010000:0.0:1789081677.128478:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c994970d/0xb7cb3d7479d5fcde lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a94c expref: 8 pid: 6584 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081677.128555:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 44 00000100:00100000:0.0:1789081677.128568:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d11fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41476931-e751-413e-b98c-64d4d0edcd05+8:2350:x1875987796109952:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789081677.128589:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789081677.128618:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c994970d/0xb7cb3d7479d5fcde lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a94c expref: 8 pid: 6584 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.128634:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c994970d/0xb7cb3d7479d5fcde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a94c expref: 8 pid: 6584 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.128664:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c994970d/0xb7cb3d7479d5fcde lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a94c expref: 8 pid: 6584 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.128685:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789081677.128690:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789081677.128706:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000819e4087/0xb7cb3d7479d5fcfa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.128719:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000819e4087/0xb7cb3d7479d5fcfa lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.128758:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789081677.128800:0:6582:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000819e4087/0xb7cb3d7479d5fcfa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081677.128838:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d11fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41476931-e751-413e-b98c-64d4d0edcd05+7:2350:x1875987796109952:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 272us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081677.128863:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 44 00010000:00010000:3.0:1789081677.128875:0:6582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000819e4087/0xb7cb3d7479d5fcfa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.128918:0:6582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000819e4087/0xb7cb3d7479d5fcfa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.128941:0:6582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000819e4087/0xb7cb3d7479d5fcfa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.128955:0:6582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000819e4087/0xb7cb3d7479d5fcfa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.128963:0:6582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998000 already unused, calling callback (ffffffffc1784220) 00010000:00010000:3.0:1789081677.128969:0:6582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000819e4087/0xb7cb3d7479d5fcfa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.128979:0:6582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000819e4087/0xb7cb3d7479d5fcfa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.129005:0:6582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000819e4087/0xb7cb3d7479d5fcfa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.129014:0:6582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000819e4087/0xb7cb3d7479d5fcfa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081677.129116:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c8a1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41476931-e751-413e-b98c-64d4d0edcd05+6:2349:x1875987796109824:12345-192.168.201.17@tcp:1:lhsmtool_posix.0 Request processed in 7117us (7312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081677.129129:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 32 00000100:00100000:2.0:1789081677.145330:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081677.145611:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796110208 00000100:00100000:3.0:1789081677.145626:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796110208 00000100:00100000:3.0:1789081677.145706:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 83 00000100:00100000:3.0:1789081677.145733:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d11fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+12:10437:x1875987796110208:12345-192.168.201.17@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789081677.145836:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fd01 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.145854:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fd01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.145870:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fd01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.146134:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d5fd08 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.146147:0:9245:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fcbb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a937 expref: 13 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.146156:0:9245:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d5fd08 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.146192:0:9245:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fcbb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a937 expref: 13 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.146208:0:9245:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fcbb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a937 expref: 13 pid: 9245 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081677.146225:0:9245:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5f0dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9245:1875987821296896:192.168.201.17@tcp:104: 00000100:00100000:3.0:1789081677.146327:0:9245:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c539f840 going to sleep for 11 seconds 00000100:00100000:2.0:1789081677.150445:0:9245:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5f0dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9245:1875987821296896:192.168.201.17@tcp:104: 00010000:00010000:2.0:1789081677.150484:0:9245:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d5fd08 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081677.155516:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081677.155675:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796110336 00000100:00100000:3.0:1789081677.155688:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796110336 00010000:00010000:3.0:1789081677.155733:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fcbb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a937 expref: 14 pid: 9245 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081677.155794:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 45 00000100:00100000:3.0:1789081677.155806:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2defb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41476931-e751-413e-b98c-64d4d0edcd05+14:2350:x1875987796110336:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789081677.155822:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081677.155830:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fcbb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a937 expref: 14 pid: 9245 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.155844:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fcbb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a937 expref: 14 pid: 9245 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.155866:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fcbb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a937 expref: 14 pid: 9245 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.155883:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e10d19d3400) 00010000:00010000:3.0:1789081677.155888:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d5fd08 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.155897:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d5fd08 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.155904:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d5fd08 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.155936:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789081677.155991:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2defb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41476931-e751-413e-b98c-64d4d0edcd05+13:2350:x1875987796110336:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 187us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081677.155998:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 45 00010000:00010000:2.0:1789081677.156062:0:9245:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d5fd08 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.156071:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d5fd08 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789081677.156350:0:9245:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1789081677.156588:0:9245:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:2.0:1789081677.156656:0:9245:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1789081677.158008:0:9245:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9484380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9245:1875987821297024:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789081677.158088:0:9245:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081677.158128:0:9245:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c53f7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789081677.158885:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821297024 00000100:00100000:2.0:1789081677.158895:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821297024 00000100:00100000:2.0:1789081677.158969:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789081677.158983:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9245:x1875987821297024:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789081677.159106:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9245:x1875987821297024:12345-0@lo:1000:mdt00_004.0 Request processed in 128us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081677.159114:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789081677.160816:0:9245:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1789081677.160826:0:9245:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e10f5c7b100, transno 4294967303 00000100:00100000:2.0:1789081677.160845:0:9245:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9484380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9245:1875987821297024:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1789081677.161412:0:9245:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:2.0:1789081677.161492:0:9245:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c50baa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9245:1875987821297152:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789081677.161565:0:9245:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081677.161592:0:9245:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c53f7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789081677.161619:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821297152 00000100:00100000:2.0:1789081677.161625:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821297152 00000100:00100000:2.0:1789081677.161662:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789081677.161670:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9245:x1875987821297152:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789081677.161840:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9245:x1875987821297152:12345-0@lo:1000:mdt00_004.0 Request processed in 170us (274us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789081677.161848:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789081677.161883:0:9245:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c50baa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9245:1875987821297152:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1789081677.161919:0:9245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d5fd08 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.161928:0:9245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d5fd08 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.161935:0:9245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d5fd08 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.161941:0:9245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081677.161945:0:9245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d5fd08 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.161952:0:9245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d5fd08 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.161968:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e10d19d3400) 00010000:00010000:2.0:1789081677.161971:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789081677.161975:0:9245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d5fd08 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.161982:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d5fd08 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.162014:0:9245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5fc36 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.162033:0:9245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5fc36 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.162039:0:9245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5fc36 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.162053:0:9245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999400 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081677.162056:0:9245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5fc36 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.162062:0:9245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5fc36 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.162071:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10d046ff00) 00010000:00010000:2.0:1789081677.162073:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789081677.162076:0:9245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5fc36 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.162081:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d5fc36 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.162104:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d5fd0f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.162120:0:9245:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fc52 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a91b expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.162130:0:9245:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d5fd0f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.162154:0:9245:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fc52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a91b expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.162168:0:9245:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fc52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a91b expref: 16 pid: 5791 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081677.162190:0:9245:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b7800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9245:1875987821297280:192.168.201.17@tcp:104: 00000100:00100000:2.0:1789081677.162261:0:9245:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c53f7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789081677.170503:0:9245:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b7800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9245:1875987821297280:192.168.201.17@tcp:104: 00010000:00010000:2.0:1789081677.170574:0:9245:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d5fd0f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081677.171773:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081677.172699:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796110464 00000100:00100000:2.0:1789081677.172709:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796110464 00010000:00010000:2.0:1789081677.172752:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fc52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a91b expref: 17 pid: 5791 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081677.172789:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 46 00000100:00100000:2.0:1789081677.172798:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41476931-e751-413e-b98c-64d4d0edcd05+17:2350:x1875987796110464:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789081677.172814:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789081677.172889:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fc52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a91b expref: 17 pid: 5791 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.172903:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fc52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a91b expref: 17 pid: 5791 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.172926:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fc52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a91b expref: 17 pid: 5791 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.172942:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10d046ff00) 00010000:00010000:2.0:1789081677.172957:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d5fd0f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.172967:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d5fd0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.172976:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d5fd0f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.173004:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789081677.173079:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41476931-e751-413e-b98c-64d4d0edcd05+16:2350:x1875987796110464:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 281us (1315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081677.173088:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 46 00010000:00010000:2.0:1789081677.173130:0:9245:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d5fd0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.173138:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d5fd0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.173149:0:9245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d5fd0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.173155:0:9245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d5fd0f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.173162:0:9245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d5fd0f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.173168:0:9245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101774600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081677.173173:0:9245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d5fd0f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.173179:0:9245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d5fd0f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.173197:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10d046ff00) 00010000:00010000:2.0:1789081677.173200:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081677.173204:0:9245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d5fd0f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.173210:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d5fd0f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.173222:0:9245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fd01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.173229:0:9245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fd01 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.173235:0:9245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fd01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.173240:0:9245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998000 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081677.173242:0:9245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fd01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.173248:0:9245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fd01 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.173257:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10d046ff00) 00010000:00010000:2.0:1789081677.173260:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789081677.173263:0:9245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fd01 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.173270:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fd01 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789081677.174091:0:11539:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789081677.174104:0:11539:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789081677.174153:0:11539:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789081677.174163:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789081677.175986:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d11fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+15:10437:x1875987796110208:12345-192.168.201.17@tcp:57:lhsmtool_posix.0 Request processed in 30247us (30661us total) trans 4294967361 rc 0/0 00000100:00100000:2.0:1789081677.175999:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 83 00000020:00080000:2.0:1789081677.176005:0:9245:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789081677.178753:0:11855:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789081677.178762:0:11855:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789081677.178804:0:11855:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789081677.178809:0:11855:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789081677.184734:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081677.189985:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796110720 00000100:00100000:3.0:1789081677.190001:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796110720 00000100:00100000:3.0:1789081677.190118:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 20 00000100:00100000:3.0:1789081677.190129:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+15:10437:x1875987796110720:12345-192.168.201.17@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789081677.190889:0:5793:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789081677.191001:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967362 00010000:00010000:3.0:1789081677.191063:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fd16 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.191080:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fd16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.191092:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fd16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.191100:0:5793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fd16 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.191108:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fd16 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.191115:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fd16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.191141:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789081677.191176:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789081677.191200:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fd16 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.191210:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999000 already unused, calling callback (ffffffffc1784220) 00010000:00010000:1.0:1789081677.191215:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fd16 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.191227:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fd16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.191249:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e10d046f700) 00000100:00100000:3.0:1789081677.191257:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+17:10437:x1875987796110720:12345-192.168.201.17@tcp:35:lhsmtool_posix.0 Request processed in 1124us (6526us total) trans 4294967363 rc 0/0 00010000:00010000:1.0:1789081677.191259:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789081677.191266:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fd16 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081677.191282:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 20 00010000:00010000:1.0:1789081677.191283:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fd16 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789081677.191293:0:5793:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789081677.191315:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081677.191319:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081677.191321:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081677.411419:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081677.411581:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796110976 00000100:00100000:0.0:1789081677.411594:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796110976 00000100:00100000:0.0:1789081677.411666:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 84 00000100:00100000:0.0:1789081677.411678:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+17:10447:x1875987796110976:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:0.0:1789081677.411713:0:7252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081677.411745:0:7252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d5fd1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a953 expref: -99 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.412112:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983a00/0xb7cb3d7479d5fd24 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.412132:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983a00/0xb7cb3d7479d5fd24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.412148:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983a00/0xb7cb3d7479d5fd24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789081677.412163:0:7252:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1789081677.412373:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d5fd1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a953 expref: 20 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.412395:0:7252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983a00/0xb7cb3d7479d5fd24 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a953 expref: 19 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.412405:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e10d19d3a00) 00010000:00010000:0.0:1789081677.412408:0:7252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789081677.412412:0:7252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101983a00, rc 0) 00000100:00100000:0.0:1789081677.412508:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+19:10447:x1875987796110976:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 831us (1104us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1789081677.412517:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 84 00000100:00100000:3.0:1789081677.429871:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081677.433153:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796111104 00000100:00100000:1.0:1789081677.433176:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796111104 00000100:00100000:1.0:1789081677.433278:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 85 00000100:00100000:1.0:1789081677.433291:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+19:10447:x1875987796111104:12345-192.168.201.17@tcp:34:lfs.0 00010000:00010000:1.0:1789081677.433411:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afa00/0xb7cb3d7479d5fd32 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.433435:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afa00/0xb7cb3d7479d5fd32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.433450:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afa00/0xb7cb3d7479d5fd32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.433488:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fd39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.433496:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fd39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.433504:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fd39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.433933:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d5fd40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.433943:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d5fd40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.433951:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d5fd40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789081677.434003:0:5789:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d5fd40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.434033:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afa00/0xb7cb3d7479d5fd32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.434041:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afa00/0xb7cb3d7479d5fd32 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.434049:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afa00/0xb7cb3d7479d5fd32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.434056:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13afa00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081677.434060:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afa00/0xb7cb3d7479d5fd32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.434077:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afa00/0xb7cb3d7479d5fd32 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.434092:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e10d19d3a00) 00010000:00010000:1.0:1789081677.434095:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789081677.434101:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afa00/0xb7cb3d7479d5fd32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.434109:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afa00/0xb7cb3d7479d5fd32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.434126:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fd39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.434132:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fd39 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.434138:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fd39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.434143:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13af400 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081677.434145:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fd39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.434151:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fd39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.434158:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e10c7ecf000) 00010000:00010000:1.0:1789081677.434160:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789081677.434163:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fd39 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.434180:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fd39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.434198:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d5fd40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.434204:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d5fd40 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.434209:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d5fd40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.434214:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13ae600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081677.434218:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d5fd40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.434224:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d5fd40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.434233:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10c7ecf900) 00010000:00010000:1.0:1789081677.434235:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789081677.434238:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d5fd40 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.434244:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d5fd40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081677.434370:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+19:10447:x1875987796111104:12345-192.168.201.17@tcp:34:lfs.0 Request processed in 1077us (4510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081677.434382:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 85 00000100:00100000:0.0:1789081677.556121:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081677.556812:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796111360 00000100:00100000:2.0:1789081677.556828:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796111360 00000100:00100000:2.0:1789081677.556921:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 86 00000100:00100000:2.0:1789081677.556933:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+19:10450:x1875987796111360:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:2.0:1789081677.556961:0:9245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081677.556990:0:9245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fd47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a95a expref: -99 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.557135:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d5fd4e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.557155:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d5fd4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.557170:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d5fd4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.557187:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d5fd55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.557196:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d5fd55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.557203:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d5fd55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.557638:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774200/0xb7cb3d7479d5fd5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.557649:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774200/0xb7cb3d7479d5fd5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.557657:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774200/0xb7cb3d7479d5fd5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789081677.557670:0:9245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789081677.557793:0:9245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d5fd4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.557803:0:9245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d5fd4e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.557812:0:9245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d5fd4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.557820:0:9245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101774600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081677.557825:0:9245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d5fd4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.557836:0:9245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d5fd4e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.557851:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e10d19d3a00) 00010000:00010000:2.0:1789081677.557854:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081677.557860:0:9245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d5fd4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.557878:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d5fd4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.557894:0:9245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d5fd55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.557901:0:9245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d5fd55 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.557909:0:9245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d5fd55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.557914:0:9245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101774800 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081677.557918:0:9245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d5fd55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.557925:0:9245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d5fd55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.557933:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e10c9a92300) 00010000:00010000:2.0:1789081677.557935:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081677.557938:0:9245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d5fd55 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.557945:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d5fd55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.557997:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fd47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a95a expref: 22 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.558022:0:9245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774200/0xb7cb3d7479d5fd5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a95a expref: 21 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081677.558039:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10c9a92000) 00010000:00010000:2.0:1789081677.558042:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789081677.558044:0:9245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101774200, rc 0) 00000100:00100000:3.0:1789081677.558248:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+21:10450:x1875987796111360:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 1314us (2140us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1789081677.558259:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 86 00000100:00100000:3.0:1789081677.561975:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081677.562139:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796111488 00000100:00100000:0.0:1789081677.562153:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796111488 00000100:00100000:0.0:1789081677.562285:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 87 00000100:00100000:0.0:1789081677.562297:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+21:10450:x1875987796111488:12345-192.168.201.17@tcp:54:lfs.0 00010000:00010000:0.0:1789081677.564201:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fd6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.564235:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fd6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.564254:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fd6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.564300:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fd6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.564308:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fd6a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.564317:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fd6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.564324:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101982600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081677.564330:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fd6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.564339:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fd6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.564375:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10c9a92000) 00010000:00010000:0.0:1789081677.564379:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789081677.564385:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fd6a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.564392:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fd6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081677.564540:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+21:10450:x1875987796111488:12345-192.168.201.17@tcp:54:lfs.0 Request processed in 2222us (2557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081677.564553:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 87 00000100:00100000:3.0:1789081677.567165:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081677.567905:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796111744 00000100:00100000:2.0:1789081677.567919:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796111744 00000100:00100000:2.0:1789081677.568001:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 21 00000100:00100000:2.0:1789081677.568025:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b66050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+21:10450:x1875987796111744:12345-192.168.201.17@tcp:35:lfs.0 00000100:00100000:2.0:1789081677.568370:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b66050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+22:10450:x1875987796111744:12345-192.168.201.17@tcp:35:lfs.0 Request processed in 358us (1217us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1789081677.568379:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 21 00010000:00010000:2.0:1789081677.596671:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789081677.658956:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081677.659070:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796112000 00000100:00100000:1.0:1789081677.659085:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796112000 00000100:00100000:1.0:1789081677.659167:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 88 00000100:00100000:1.0:1789081677.659179:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+22:9978:x1875987796112000:12345-192.168.201.17@tcp:101:bash.0 00010000:00010000:1.0:1789081677.659212:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081677.659241:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d5fd71 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a961 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.659371:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fd78 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.659389:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774200/0xb7cb3d7479d5fd5c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a95a expref: 23 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.659400:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fd78 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.659442:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774200/0xb7cb3d7479d5fd5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a95a expref: 23 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.659458:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774200/0xb7cb3d7479d5fd5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a95a expref: 23 pid: 9245 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081677.659473:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5dd8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5791:1875987821297408:192.168.201.17@tcp:104: 00000100:00100000:1.0:1789081677.659666:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c4c54c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789081677.663746:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081677.664241:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5dd8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5791:1875987821297408:192.168.201.17@tcp:104: 00010000:00010000:1.0:1789081677.664282:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fd78 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081677.667721:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796112128 00000100:00100000:2.0:1789081677.667746:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796112128 00010000:00010000:3.0:1789081677.675556:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774200/0xb7cb3d7479d5fd5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a95a expref: 24 pid: 9245 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081677.675775:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 47 00000100:00100000:3.0:1789081677.675790:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41476931-e751-413e-b98c-64d4d0edcd05+24:2350:x1875987796112128:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789081677.675824:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081677.675833:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774200/0xb7cb3d7479d5fd5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a95a expref: 24 pid: 9245 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.675850:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774200/0xb7cb3d7479d5fd5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a95a expref: 24 pid: 9245 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.675881:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774200/0xb7cb3d7479d5fd5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a95a expref: 24 pid: 9245 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.675940:0:7481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10c9a92000) 00010000:00010000:3.0:1789081677.675946:0:7481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fd78 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.675956:0:7481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fd78 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.675966:0:7481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fd78 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.676016:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789081677.676110:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41476931-e751-413e-b98c-64d4d0edcd05+23:2350:x1875987796112128:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 325us (12380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081677.676119:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 47 00010000:00010000:1.0:1789081677.677798:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fd78 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.677818:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fd78 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789081677.677850:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1789081677.678120:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d5fd71 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a961 expref: 24 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.678151:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fd78 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a961 expref: 23 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.678161:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10c9a92000) 00010000:00010000:1.0:1789081677.678164:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789081677.678169:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13af400, rc 0) 00000100:00100000:1.0:1789081677.678304:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+23:9978:x1875987796112000:12345-192.168.201.17@tcp:101:bash.0 Request processed in 19126us (19363us total) trans 4294967367 rc 0/0 00000100:00100000:1.0:1789081677.678315:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 88 00000100:00100000:2.0:1789081677.702577:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081677.702735:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796112384 00000100:00100000:0.0:1789081677.702749:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796112384 00000100:00100000:0.0:1789081677.702839:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 89 00000100:00100000:0.0:1789081677.702851:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+23:9978:x1875987796112384:12345-192.168.201.17@tcp:36:bash.0 00010000:00010000:0.0:1789081677.703275:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5fd86 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.703297:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5fd86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.703310:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5fd86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789081677.703366:0:9245:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000004:00010000:0.0:1789081677.703390:0:9245:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dee3d687 reply state 000000007d63e91c transno 4294967369 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5fd86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081677.703401:0:9245:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1789081677.703459:0:9245:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000100:00100000:0.0:1789081677.703632:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+27:9978:x1875987796112384:12345-192.168.201.17@tcp:36:bash.0 Request processed in 781us (1068us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1789081677.703640:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 89 00000020:00080000:0.0:1789081677.703646:0:9245:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789081677.718326:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081677.720290:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796112512 00000100:00100000:1.0:1789081677.720312:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796112512 00000100:00100000:1.0:1789081677.720419:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 90 00000100:00100000:1.0:1789081677.720431:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+27:9978:x1875987796112512:12345-192.168.201.17@tcp:101:bash.0 00010000:00010000:1.0:1789081677.720467:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081677.720498:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d5fd8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a968 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.720673:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d5fd8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a968 expref: 28 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.720692:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d5fd8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a968 expref: 28 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.720715:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10c9a92000) 00010000:00010000:1.0:1789081677.720719:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789081677.720724:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13ae600, rc 0) 00000100:00100000:1.0:1789081677.720810:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+28:9978:x1875987796112512:12345-192.168.201.17@tcp:101:bash.0 Request processed in 381us (2500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081677.720818:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 90 00010000:00010000:3.0:1789081677.727091:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5fd86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.727115:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5fd86 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.727124:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5fd86 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.727131:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101983c00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081677.727138:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5fd86 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.727147:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5fd86 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.727201:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10c9a92000) 00010000:00010000:3.0:1789081677.727205:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081677.727210:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5fd86 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.727218:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5fd86 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081677.727581:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081677.727790:0:7788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796112640 00000100:00100000:1.0:1789081677.727804:0:7788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796112640 00000100:00100000:1.0:1789081677.727884:0:7788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 33 00000100:00100000:1.0:1789081677.727896:0:7788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41476931-e751-413e-b98c-64d4d0edcd05+6:9978:x1875987796112640:12345-192.168.201.17@tcp:101:bash.0 00010000:00010000:1.0:1789081677.727921:0:7788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081677.727949:0:7788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4df4081/0xb7cb3d7479d5fd94 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a96f expref: -99 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789081677.727997:0:7788:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa3384b, atime: 0x6aa3384a, ctime: 0x6aa3384b, blocks: 0xb 00010000:00010000:1.0:1789081677.728038:0:7788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=344s v=(0 0) 00010000:00010000:1.0:1789081677.728044:0:7788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789081677.728055:0:7788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4df4081/0xb7cb3d7479d5fd94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a96f expref: 7 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.728094:0:7788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d4df4081/0xb7cb3d7479d5fd94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a96f expref: 7 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.728110:0:7788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13afa00, rc 0) 00000100:00100000:1.0:1789081677.728193:0:7788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41476931-e751-413e-b98c-64d4d0edcd05+7:9978:x1875987796112640:12345-192.168.201.17@tcp:101:bash.0 Request processed in 298us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081677.728202:0:7788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 33 00000100:00100000:2.0:1789081677.731214:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081677.735655:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796112768 00000100:00100000:0.0:1789081677.735677:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796112768 00002000:00010000:0.0:1789081677.735749:0:6587:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1789081677.735756:0:6587:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e10f9484700 with x1875987796112768 ext(0->18446744073709551615) 00002000:00010000:0.0:1789081677.735774:0:6587:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e10f9484700. 00000100:00100000:0.0:1789081677.735834:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 1 00000100:00100000:0.0:1789081677.735847:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9484700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41476931-e751-413e-b98c-64d4d0edcd05+7:2351:x1875987796112768:12345-192.168.201.17@tcp:10:bash.0 00002000:00010000:0.0:1789081677.736252:0:6587:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789081677.736256:0:6587:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789081675 -> 1789081677 00002000:00010000:0.0:1789081677.736259:0:6587:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1789081674 -> 1789081674 00002000:00010000:0.0:1789081677.736261:0:6587:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789081675 -> 1789081677 00002000:00010000:0.0:1789081677.736263:0:6587:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1789081677.736357:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9484700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41476931-e751-413e-b98c-64d4d0edcd05+8:2351:x1875987796112768:12345-192.168.201.17@tcp:10:bash.0 Request processed in 511us (5156us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789081677.736366:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 1 00002000:00010000:0.0:1789081677.736370:0:6587:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1789081677.736373:0:6587:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e10f9484700 with x1875987796112768 ext(0->18446744073709551615) 00002000:00010000:0.0:1789081677.736378:0:6587:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e10f9484700. 00000100:00100000:2.0:1789081677.856351:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081677.856478:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796112896 00000100:00100000:1.0:1789081677.856491:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796112896 00000100:00100000:1.0:1789081677.856612:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 91 00000100:00100000:1.0:1789081677.856624:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+27:10464:x1875987796112896:12345-192.168.201.17@tcp:34:lfs.0 00010000:00010000:1.0:1789081677.856748:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5fd9b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.856771:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5fd9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.856788:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5fd9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.856876:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5fda2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.856886:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5fda2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.856894:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5fda2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.857272:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5fda9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.857283:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5fda9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.857289:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5fda9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789081677.857342:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5fda9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.857356:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5fd9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.857365:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5fd9b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.857373:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5fd9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.857380:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13afe00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081677.857385:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5fd9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.857394:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5fd9b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.857407:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e10d19d3a00) 00010000:00010000:1.0:1789081677.857411:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789081677.857416:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5fd9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.857428:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5fd9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.857443:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5fda2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.857448:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5fda2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.857454:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5fda2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.857458:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13aee00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081677.857460:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5fda2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.857465:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5fda2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.857472:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e10c7ecf500) 00010000:00010000:1.0:1789081677.857474:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789081677.857477:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5fda2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.857483:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5fda2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.857499:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5fda9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.857505:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5fda9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.857516:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5fda9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.857727:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13af600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081677.857730:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5fda9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.857737:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5fda9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.857745:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10c9a92000) 00010000:00010000:1.0:1789081677.857748:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789081677.857751:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5fda9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.857756:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5fda9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081677.857926:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+27:10464:x1875987796112896:12345-192.168.201.17@tcp:34:lfs.0 Request processed in 1302us (1588us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081677.857936:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 91 00000100:00100000:2.0:1789081677.933649:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081677.933774:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796113152 00000100:00100000:1.0:1789081677.933789:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796113152 00000100:00100000:1.0:1789081677.933887:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 92 00000100:00100000:1.0:1789081677.933907:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+27:10467:x1875987796113152:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:1.0:1789081677.933939:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081677.933970:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5fdb0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a976 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.934137:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5fdb7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.934156:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5fdb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.934171:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5fdb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.934189:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5fdbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.934195:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5fdbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081677.934202:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5fdbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.937572:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d5fdc5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.937601:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d5fdc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.937629:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d5fdc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789081677.937648:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789081677.937789:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5fdb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.937800:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5fdb7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.939144:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5fdb7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.939154:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13aee00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081677.939160:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5fdb7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.939169:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5fdb7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.939191:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e10d19d3a00) 00010000:00010000:0.0:1789081677.939195:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081677.939202:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5fdb7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.939210:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5fdb7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.939238:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5fdbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.939244:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5fdbe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.939272:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5fdbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.939278:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13afe00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081677.939281:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5fdbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.939287:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5fdbe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.939295:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e10c7ecf500) 00010000:00010000:0.0:1789081677.939297:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081677.939301:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5fdbe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.939306:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5fdbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.939390:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5fdb0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a976 expref: 30 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.939408:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d5fdc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a976 expref: 29 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.939417:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10c9a92000) 00010000:00010000:0.0:1789081677.939420:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789081677.939423:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101982400, rc 0) 00000100:00100000:0.0:1789081677.939660:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+29:10467:x1875987796113152:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 5760us (6024us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1789081677.939680:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 92 00000100:00100000:2.0:1789081677.951497:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081677.951794:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796113280 00000100:00100000:0.0:1789081677.951807:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796113280 00000100:00100000:0.0:1789081677.951893:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 93 00000100:00100000:0.0:1789081677.951915:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+29:10467:x1875987796113280:12345-192.168.201.17@tcp:54:lfs.0 00010000:00010000:0.0:1789081677.952095:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fdd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.952117:0:7252:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fd78 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a961 expref: 29 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.952128:0:7252:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fdd3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.952172:0:7252:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fd78 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a961 expref: 29 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.952188:0:7252:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fd78 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a961 expref: 29 pid: 5791 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081677.952205:0:7252:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff647b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7252:1875987821297536:192.168.201.17@tcp:104: 00000100:00100000:0.0:1789081677.952333:0:7252:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c8e87b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789081677.959354:0:7252:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff647b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7252:1875987821297536:192.168.201.17@tcp:104: 00010000:00010000:0.0:1789081677.959401:0:7252:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fdd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081677.963838:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081677.964257:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796113536 00000100:00100000:3.0:1789081677.964272:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796113536 00000100:00100000:3.0:1789081677.964348:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 22 00000100:00100000:3.0:1789081677.964360:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101c32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+30:5566:x1875987796113536:12345-192.168.201.17@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789081677.968190:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101c32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+31:5566:x1875987796113536:12345-192.168.201.17@tcp:35:ldlm_bl.0 Request processed in 3817us (4351us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1789081677.968206:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 22 00000100:00100000:2.0:1789081677.974503:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081677.974705:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796113664 00000100:00100000:0.0:1789081677.974734:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796113664 00010000:00010000:0.0:1789081677.974791:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fd78 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a961 expref: 31 pid: 5791 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081677.974841:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 48 00000100:00100000:0.0:1789081677.974854:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101c30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41476931-e751-413e-b98c-64d4d0edcd05+31:2351:x1875987796113664:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789081677.974873:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789081677.974881:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fd78 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a961 expref: 31 pid: 5791 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.974908:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fd78 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a961 expref: 31 pid: 5791 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.974939:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fd78 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a961 expref: 31 pid: 5791 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.974960:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10c9a92000) 00010000:00010000:0.0:1789081677.974977:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fdd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.974989:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fdd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.974999:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fdd3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081677.975106:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789081677.975230:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101c30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41476931-e751-413e-b98c-64d4d0edcd05+30:2351:x1875987796113664:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 371us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081677.975250:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 48 00010000:00010000:3.0:1789081677.975788:0:7252:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fdd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.975801:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fdd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.975849:0:7252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fdd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.975857:0:7252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fdd3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.975865:0:7252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fdd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.975885:0:7252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101982000 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081677.975891:0:7252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fdd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.975899:0:7252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fdd3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.975911:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10c9a92000) 00010000:00010000:3.0:1789081677.975914:0:7252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789081677.979380:0:7252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fdd3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081677.979407:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fdd3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081677.979884:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+29:10467:x1875987796113280:12345-192.168.201.17@tcp:54:lfs.0 Request processed in 27973us (28393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081677.979897:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 93 00000100:00100000:2.0:1789081677.990481:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081677.995761:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796113920 00000100:00100000:0.0:1789081677.995783:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796113920 00000100:00100000:1.0:1789081677.997105:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 23 00000100:00100000:1.0:1789081677.997126:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101c33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+29:10467:x1875987796113920:12345-192.168.201.17@tcp:35:lfs.0 00000100:00100000:1.0:1789081677.997479:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101c33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+30:10467:x1875987796113920:12345-192.168.201.17@tcp:35:lfs.0 Request processed in 361us (7012us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1789081677.997487:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 23 00000100:00100000:2.0:1789081678.097338:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081678.097581:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796114176 00000100:00100000:1.0:1789081678.097597:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796114176 00000100:00100000:1.0:1789081678.097679:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 94 00000100:00100000:1.0:1789081678.097692:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101c30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+30:10478:x1875987796114176:12345-192.168.201.17@tcp:101:cat.0 00010000:00010000:1.0:1789081678.097726:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081678.097774:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d5fdda lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a97d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.097891:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fde1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.097909:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fde1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.097923:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fde1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.097940:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5fde8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.097947:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5fde8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.097954:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5fde8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.098961:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5fdef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.098980:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5fdef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.098990:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5fdef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789081678.099019:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1789081678.099162:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fde1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.099186:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fde1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.099194:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fde1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.099202:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13af400 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081678.099208:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fde1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.099218:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fde1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.099247:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e10d19d3a00) 00010000:00010000:1.0:1789081678.099251:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789081678.099257:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fde1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.099265:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fde1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.099282:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5fde8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.099289:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5fde8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.099296:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5fde8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.099302:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13af600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081678.099312:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5fde8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.099320:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5fde8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.099328:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e10c7ecf800) 00010000:00010000:1.0:1789081678.099331:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789081678.099334:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5fde8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.099341:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5fde8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.099402:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d5fdda lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a97d expref: 33 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.099422:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5fdef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a97d expref: 32 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.099431:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10c9a92000) 00010000:00010000:1.0:1789081678.099434:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789081678.099437:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13afe00, rc 0) 00000100:00100000:1.0:1789081678.099593:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101c30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+32:10478:x1875987796114176:12345-192.168.201.17@tcp:101:cat.0 Request processed in 1902us (2271us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1789081678.099604:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 94 00000100:00100000:2.0:1789081678.108378:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081678.108558:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796114432 00000100:00100000:3.0:1789081678.108573:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796114432 00000100:00100000:3.0:1789081678.108668:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 24 00000100:00100000:3.0:1789081678.108681:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101c31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+32:10478:x1875987796114432:12345-192.168.201.17@tcp:35:cat.0 00000100:00100000:3.0:1789081678.109032:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101c31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+33:10478:x1875987796114432:12345-192.168.201.17@tcp:35:cat.0 Request processed in 353us (671us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1789081678.110170:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 24 00000100:00100000:2.0:1789081678.130643:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081678.130847:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796114688 00000100:00100000:0.0:1789081678.130861:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796114688 00000100:00100000:0.0:1789081678.130940:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 95 00000100:00100000:0.0:1789081678.130953:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101c30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+33:10479:x1875987796114688:12345-192.168.201.17@tcp:36:rm.0 00010000:00010000:0.0:1789081678.131057:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789081678.131100:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5fdef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a97d expref: 33 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.131128:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d5fdc5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a976 expref: 32 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.131142:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d5fd8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a968 expref: 31 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.131155:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10c9a92000) 00010000:00010000:0.0:1789081678.131168:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789081678.131197:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fdfd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.131214:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fdfd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.131234:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fdfd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.131251:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d5fe04 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.131268:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d5fe04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.131274:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d5fe04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.131721:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5fe0b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.131731:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5fe0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.131739:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5fe0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789081678.132432:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1789081678.132448:0:5789:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 345014923759ns, next at 346014919004ns, rc = 0 00010000:00010000:0.0:1789081678.132583:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fe12 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.132598:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fe12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.132608:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fe12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.132617:0:5789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fe12 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.132623:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fe12 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.132640:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fe12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.132678:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789081678.132707:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5fe0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.132713:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5fe0b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.132720:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5fe0b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.132727:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101983400 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081678.132732:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5fe0b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.132741:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5fe0b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.132756:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10d19d3000) 00010000:00010000:0.0:1789081678.132759:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789081678.132764:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5fe0b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.132771:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5fe0b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.132792:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fdfd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.132798:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fdfd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.132811:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fdfd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.132816:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101983000 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081678.132819:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fdfd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.132825:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fdfd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.132833:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e10d19d3a00) 00010000:00010000:0.0:1789081678.132835:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081678.132838:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fdfd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.132843:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5fdfd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789081678.132853:0:5789:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001d3f681f reply state 00000000bd9515fa transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d5fe04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081678.132863:0:5789:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789081678.132979:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101c30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+32:10479:x1875987796114688:12345-192.168.201.17@tcp:36:rm.0 Request processed in 2025us (2357us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1789081678.132989:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 95 00010000:00010000:0.0:1789081678.133668:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789081678.133678:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fe12 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.133687:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101982000 already unused, calling callback (ffffffffc1784220) 00010000:00010000:0.0:1789081678.133700:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fe12 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.133708:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fe12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.133722:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e10d19d3000) 00010000:00010000:0.0:1789081678.133725:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789081678.133728:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fe12 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.133733:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5fe12 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.133751:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081678.133752:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081678.133754:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081678.140059:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d5fe04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.140083:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d5fe04 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.140091:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d5fe04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.140099:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101983800 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081678.140104:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d5fe04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.140113:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d5fe04 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.140160:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e10d19d3700) 00010000:00010000:0.0:1789081678.140164:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081678.140171:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d5fe04 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.140178:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d5fe04 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081678.179299:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081678.179701:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796114944 00000100:00100000:3.0:1789081678.179715:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796114944 00000100:00100000:3.0:1789081678.179793:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 96 00000100:00100000:3.0:1789081678.179832:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1029880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+31:10485:x1875987796114944:12345-192.168.201.17@tcp:101:bash.0 00010000:00010000:3.0:1789081678.179867:0:7252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081678.179896:0:7252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d5fe19 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a984 expref: -99 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.180189:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fe20 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.180209:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fe20 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.180393:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fe20 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.180414:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5fe27 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.180423:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5fe27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.180431:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5fe27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789081678.181588:0:7252:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1789081678.182494:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5fe2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.182517:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5fe2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.182584:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5fe2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.182662:0:7252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fe20 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.182670:0:7252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fe20 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.182678:0:7252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fe20 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.182686:0:7252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998800 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081678.182691:0:7252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fe20 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.182700:0:7252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fe20 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.182715:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e10d19d3a00) 00010000:00010000:3.0:1789081678.182718:0:7252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081678.182724:0:7252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fe20 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.182732:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fe20 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789081678.182751:0:7252:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000068b974bf reply state 00000000235c82c6 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5fe27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081678.182763:0:7252:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789081678.182817:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d5fe19 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a984 expref: 34 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.182851:0:7252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5fe2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a984 expref: 33 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.182861:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e10d046fe00) 00010000:00010000:3.0:1789081678.182864:0:7252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789081678.182866:0:7252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101999e00, rc 0) 00000100:00100000:3.0:1789081678.183244:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1029880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+34:10485:x1875987796114944:12345-192.168.201.17@tcp:101:bash.0 Request processed in 3412us (3958us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1789081678.183256:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 96 00000100:00100000:2.0:1789081678.190308:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00010000:00010000:0.0:1789081678.190424:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5fe27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.190439:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5fe27 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.190448:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5fe27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.190455:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998e00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081678.190461:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5fe27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.190471:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5fe27 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.190496:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e10d046f400) 00010000:00010000:0.0:1789081678.190500:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081678.190505:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5fe27 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.190513:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5fe27 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081678.190775:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796115072 00000100:00100000:3.0:1789081678.190790:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796115072 00000100:00100000:3.0:1789081678.190989:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 34 00000100:00100000:3.0:1789081678.191073:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1029500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+5:2350:x1875987796115072:12345-192.168.201.17@tcp:101:bash.0 00010000:00010000:3.0:1789081678.191099:0:6584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081678.191129:0:6584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d5fe3c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a98b expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789081678.191168:0:6584:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789081678.191194:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1789081678.191199:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081678.191211:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d5fe3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a98b expref: 6 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.191238:0:6584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d5fe3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a98b expref: 6 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.191267:0:6584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101999600, rc 0) 00000100:00100000:3.0:1789081678.191346:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1029500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+6:2350:x1875987796115072:12345-192.168.201.17@tcp:101:bash.0 Request processed in 347us (1356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081678.191354:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 34 00000100:00100000:2.0:1789081678.194463:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081678.194588:0:7788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796115200 00000100:00100000:1.0:1789081678.194602:0:7788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796115200 00000100:00100000:1.0:1789081678.194690:0:7788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 35 00000100:00100000:1.0:1789081678.194702:0:7788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1029c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41476931-e751-413e-b98c-64d4d0edcd05+6:10485:x1875987796115200:12345-192.168.201.17@tcp:101:bash.0 00010000:00010000:1.0:1789081678.194749:0:7788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081678.194778:0:7788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a8b56ad/0xb7cb3d7479d5fe43 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a992 expref: -99 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.194840:0:7788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d5fe3c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a98b expref: 7 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.194852:0:7788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789081678.194858:0:7788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789081678.194865:0:7788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a8b56ad/0xb7cb3d7479d5fe43 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a992 expref: 7 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.194914:0:7788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d5fe3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a98b expref: 7 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.194931:0:7788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d5fe3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a98b expref: 7 pid: 6584 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081678.194950:0:7788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5dd8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7788:1875987821297664:192.168.201.17@tcp:104: 00000100:00100000:1.0:1789081678.195303:0:7788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c4c54e40 going to sleep for 11 seconds 00000100:00080000:0.0:1789081678.195708:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789081678.203362:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081678.203516:0:7788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5dd8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7788:1875987821297664:192.168.201.17@tcp:104: 00010000:00010000:1.0:1789081678.203608:0:7788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a8b56ad/0xb7cb3d7479d5fe43 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a992 expref: 7 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.203646:0:7788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13aec00, rc 0) 00000100:00100000:1.0:1789081678.203750:0:7788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1029c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41476931-e751-413e-b98c-64d4d0edcd05+7:10485:x1875987796115200:12345-192.168.201.17@tcp:101:bash.0 Request processed in 9048us (9300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081678.203760:0:7788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 35 00000100:00100000:3.0:1789081678.204371:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796115328 00000100:00100000:3.0:1789081678.204382:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796115328 00010000:00010000:3.0:1789081678.204426:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d5fe3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a98b expref: 7 pid: 6584 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081678.204473:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 49 00000100:00100000:3.0:1789081678.204483:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c9388c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41476931-e751-413e-b98c-64d4d0edcd05+7:2351:x1875987796115328:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789081678.204500:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081678.204571:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d5fe3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a98b expref: 7 pid: 6584 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.204586:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d5fe3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a98b expref: 7 pid: 6584 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.204618:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d5fe3c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a98b expref: 7 pid: 6584 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.204637:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081678.204643:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081678.204653:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a8b56ad/0xb7cb3d7479d5fe43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a992 expref: 6 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.204676:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a8b56ad/0xb7cb3d7479d5fe43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a992 expref: 6 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.204723:0:5775:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007a8b56ad/0xb7cb3d7479d5fe43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a992 expref: 6 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081678.204740:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5f0d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5775:1875987821297792:192.168.201.17@tcp:105: 00000100:00100000:3.0:1789081678.205210:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c539f000 going to sleep for 11 seconds 00000100:00100000:2.0:1789081678.215989:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081678.216183:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5f0d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5775:1875987821297792:192.168.201.17@tcp:105: 00010000:00010000:0.0:1789081678.216215:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789081678.216289:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c9388c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41476931-e751-413e-b98c-64d4d0edcd05+6:2351:x1875987796115328:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 11806us (12941us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081678.216303:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 49 00000100:00100000:0.0:1789081678.216407:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796115584 00000100:00100000:0.0:1789081678.216417:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796115584 00000100:00100000:0.0:1789081678.216468:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 25 00000100:00100000:0.0:1789081678.216478:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+33:10485:x1875987796115584:12345-192.168.201.17@tcp:35:bash.0 00000100:00100000:0.0:1789081678.216932:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+34:10485:x1875987796115584:12345-192.168.201.17@tcp:35:bash.0 Request processed in 453us (955us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1789081678.216940:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 25 00000100:00100000:2.0:1789081678.493351:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081678.493627:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796115712 00000100:00100000:1.0:1789081678.493641:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796115712 00000100:00100000:1.0:1789081678.493734:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 97 00000100:00100000:1.0:1789081678.493746:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+34:10501:x1875987796115712:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:1.0:1789081678.493780:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081678.493809:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5fe4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a999 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.493895:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fe51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.493914:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fe51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.493928:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fe51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789081678.494022:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1789081678.494026:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1789081678.494066:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fe51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.494096:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5fe4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a999 expref: 36 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.494119:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fe51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a999 expref: 35 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.494151:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e10d19d3a00) 00010000:00010000:1.0:1789081678.494154:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789081678.494158:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13af400, rc 0) 00000100:00100000:1.0:1789081678.494236:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+35:10501:x1875987796115712:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 493us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081678.494245:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 97 00000100:00100000:2.0:1789081678.501039:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081678.504648:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796115968 00000100:00100000:3.0:1789081678.504668:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796115968 00000100:00100000:3.0:1789081678.504755:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 98 00000100:00100000:3.0:1789081678.504767:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+35:10501:x1875987796115968:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:3.0:1789081678.504801:0:9245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081678.504834:0:9245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d5fe58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a9a0 expref: -99 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.504941:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fe5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.504955:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fe5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.504966:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fe5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789081678.504978:0:9245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789081678.505140:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d5fe58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9a0 expref: 38 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.505160:0:9245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fe5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9a0 expref: 37 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.505170:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e10d046fe00) 00010000:00010000:3.0:1789081678.505173:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789081678.505177:0:9245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101998800, rc 0) 00000100:00100000:3.0:1789081678.505252:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+37:10501:x1875987796115968:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 487us (4222us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1789081678.505260:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 98 00000100:00100000:2.0:1789081678.511133:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081678.511376:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796116224 00000100:00100000:3.0:1789081678.511386:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796116224 00000100:00100000:3.0:1789081678.511449:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 99 00000100:00100000:3.0:1789081678.511460:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+37:10501:x1875987796116224:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:3.0:1789081678.511485:0:7252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081678.511508:0:7252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d5fe6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a9a7 expref: -99 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.511650:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5fe74 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.511666:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5fe74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.511678:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5fe74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789081678.512934:0:7252:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789081678.513104:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d5fe6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9a7 expref: 40 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.513127:0:7252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5fe74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9a7 expref: 39 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.513137:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e10d046fe00) 00010000:00010000:3.0:1789081678.513140:0:7252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789081678.513143:0:7252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101998e00, rc 0) 00000100:00100000:3.0:1789081678.516614:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+39:10501:x1875987796116224:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 5143us (5477us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1789081678.516629:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 99 00000100:00100000:2.0:1789081678.523053:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081678.523473:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796116352 00000100:00100000:3.0:1789081678.523483:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796116352 00000100:00100000:3.0:1789081678.523579:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 6 00000100:00100000:3.0:1789081678.523590:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41476931-e751-413e-b98c-64d4d0edcd05+39:2351:x1875987796116352:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789081678.523606:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081678.523631:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fe5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9a0 expref: 39 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.523650:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e10d046fe00) 00010000:00010000:3.0:1789081678.523655:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789081678.523706:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41476931-e751-413e-b98c-64d4d0edcd05+38:2351:x1875987796116352:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 118us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081678.523714:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 6 00000100:00100000:0.0:1789081678.530008:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081678.531003:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796116480 00000100:00100000:3.0:1789081678.531024:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796116480 00000100:00100000:3.0:1789081678.531119:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 36 00000100:00100000:3.0:1789081678.531134:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff645880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+6:2350:x1875987796116480:12345-192.168.201.17@tcp:1:lfs.0 00010000:00010000:3.0:1789081678.531200:0:6584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d5fe82 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.531234:0:6584:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a8b56ad/0xb7cb3d7479d5fe43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a992 expref: 6 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.531246:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081678.531251:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789081678.531257:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d5fe82 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.531310:0:6584:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007a8b56ad/0xb7cb3d7479d5fe43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a992 expref: 6 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.531327:0:6584:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007a8b56ad/0xb7cb3d7479d5fe43 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a992 expref: 6 pid: 7788 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081678.531346:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5f0dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6584:1875987821297920:192.168.201.17@tcp:104: 00000100:00100000:3.0:1789081678.531480:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c539f840 going to sleep for 11 seconds 00000100:00100000:1.0:1789081678.537913:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081678.538380:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5f0dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6584:1875987821297920:192.168.201.17@tcp:104: 00000100:00100000:3.0:1789081678.538389:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796116608 00000100:00100000:3.0:1789081678.538403:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796116608 00010000:00010000:2.0:1789081678.538416:0:6584:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d5fe82 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1789081678.538474:0:6588:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9e10f5dd8a80 x1875987796116608/t0(0) o4->41476931-e751-413e-b98c-64d4d0edcd05@192.168.201.17@tcp:469/0 lens 504/0 e 0 to 0 dl 1789081689 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789081678.538512:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e10f5dd8a80 with x1875987796116608 ext(0->8) 00010000:00010000:3.0:1789081678.538563:0:6588:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000007a8b56ad/0xb7cb3d7479d5fe43 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a992 expref: 7 pid: 7788 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.538585:0:6588:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000007a8b56ad/0xb7cb3d7479d5fe43 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a992 expref: 7 pid: 7788 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789081678.538594:0:6588:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9e10f5dd8a80 00000100:00100000:3.0:1789081678.538639:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 1 00000100:00100000:3.0:1789081678.538651:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41476931-e751-413e-b98c-64d4d0edcd05+7:2350:x1875987796116608:12345-192.168.201.17@tcp:4:lfs.0 00000100:00100000:3.0:1789081678.539333:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41476931-e751-413e-b98c-64d4d0edcd05+9:2350:x1875987796116608:12345-192.168.201.17@tcp:4:lfs.0 Request processed in 680us (1432us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789081678.539345:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 1 00002000:00100000:3.0:1789081678.539354:0:6588:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9e10f5dd8a80 x1875987796116608/t4294967302(0) o4->41476931-e751-413e-b98c-64d4d0edcd05@192.168.201.17@tcp:469/0 lens 504/448 e 0 to 0 dl 1789081689 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789081678.539364:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e10f5dd8a80 with x1875987796116608 ext(0->8) 00010000:00010000:3.0:1789081678.539370:0:6588:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000007a8b56ad/0xb7cb3d7479d5fe43 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a992 expref: 9 pid: 7788 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.539385:0:6588:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000007a8b56ad/0xb7cb3d7479d5fe43 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a992 expref: 9 pid: 7788 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789081678.539394:0:6588:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9e10f5dd8a80 00000100:00100000:1.0:1789081678.546777:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081678.546894:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796116736 00000100:00100000:3.0:1789081678.546932:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796116736 00010000:00010000:3.0:1789081678.547029:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007a8b56ad/0xb7cb3d7479d5fe43 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a992 expref: 9 pid: 7788 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081678.547087:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 50 00000100:00100000:3.0:1789081678.547100:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41476931-e751-413e-b98c-64d4d0edcd05+9:2351:x1875987796116736:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789081678.547123:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789081678.547152:0:7481:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789081678.547156:0:7481:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789081678 00002000:00010000:3.0:1789081678.547160:0:7481:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789081678 00002000:00010000:3.0:1789081678.547163:0:7481:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789081678 00010000:00010000:3.0:1789081678.547171:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007a8b56ad/0xb7cb3d7479d5fe43 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a992 expref: 9 pid: 7788 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.547192:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007a8b56ad/0xb7cb3d7479d5fe43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a992 expref: 9 pid: 7788 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.547237:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a8b56ad/0xb7cb3d7479d5fe43 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a992 expref: 9 pid: 7788 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.547260:0:7481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789081678.547266:0:7481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789081678.547274:0:7481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d5fe82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.547288:0:7481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d5fe82 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.547343:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789081678.547418:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41476931-e751-413e-b98c-64d4d0edcd05+8:2351:x1875987796116736:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 319us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081678.547429:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 50 00010000:00010000:2.0:1789081678.547429:0:6584:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d5fe82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.547452:0:6584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d5fe82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.547497:0:6584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d5fe82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.547507:0:6584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d5fe82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.547515:0:6584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d5fe82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.547590:0:6584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999600 already unused, calling callback (ffffffffc1784220) 00010000:00010000:2.0:1789081678.547595:0:6584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d5fe82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.547604:0:6584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d5fe82 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.547625:0:6584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d5fe82 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.547633:0:6584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d5fe82 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081678.547736:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff645880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+7:2350:x1875987796116480:12345-192.168.201.17@tcp:1:lfs.0 Request processed in 16603us (17745us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081678.547747:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 36 00000100:00100000:2.0:1789081678.552126:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081678.552378:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796116992 00000100:00100000:0.0:1789081678.552388:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796116992 00000100:00100000:3.0:1789081678.556052:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 26 00000100:00100000:3.0:1789081678.556092:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b67050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+38:10501:x1875987796116992:12345-192.168.201.17@tcp:35:lfs.0 00000004:00010000:3.0:1789081678.556200:0:5793:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5fe74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9a7 expref: 38 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789081678.556649:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1789081678.556716:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:3.0:1789081678.557414:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00010000:00010000:3.0:1789081678.557733:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fe89 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.557753:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5fe2e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a984 expref: 42 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.557763:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fe89 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.557813:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5fe2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a984 expref: 42 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.557832:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5fe2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a984 expref: 42 pid: 7252 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081678.557871:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5f0dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5793:1875987821298048:192.168.201.17@tcp:104: 00000100:00100000:2.0:1789081678.558387:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c539f180 going to sleep for 11 seconds 00000100:00100000:1.0:1789081678.562792:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081678.562976:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5f0dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5793:1875987821298048:192.168.201.17@tcp:104: 00010000:00010000:2.0:1789081678.563021:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fe89 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081678.563179:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796117120 00000100:00100000:3.0:1789081678.563194:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796117120 00010000:00010000:3.0:1789081678.563254:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5fe2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a984 expref: 43 pid: 7252 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081678.563304:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 51 00000100:00100000:3.0:1789081678.563315:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41476931-e751-413e-b98c-64d4d0edcd05+43:2351:x1875987796117120:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789081678.563334:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081678.563344:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5fe2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a984 expref: 43 pid: 7252 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.563358:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5fe2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a984 expref: 43 pid: 7252 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.563387:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5fe2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a984 expref: 43 pid: 7252 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.563406:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e10d046fe00) 00010000:00010000:3.0:1789081678.563411:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fe89 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.563423:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fe89 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.563432:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fe89 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.563488:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789081678.563565:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fe89 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.563578:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fe89 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081678.563644:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41476931-e751-413e-b98c-64d4d0edcd05+42:2351:x1875987796117120:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 327us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081678.563655:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 51 00000001:00080000:0.0:1789081678.563718:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:0.0:1789081678.563953:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1789081678.564122:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff647b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5793:1875987821298176:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789081678.564182:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081678.564230:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d1a2e900 going to sleep for 11 seconds 00000100:00100000:3.0:1789081678.564258:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821298176 00000100:00100000:3.0:1789081678.564267:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821298176 00000100:00100000:3.0:1789081678.564336:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789081678.564347:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5793:x1875987821298176:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:0.0:1789081678.564355:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789081678.564475:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5793:x1875987821298176:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 129us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081678.564483:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789081678.564744:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff647b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5793:1875987821298176:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789081678.565367:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:0.0:1789081678.567780:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff647b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5793:1875987821298304:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789081678.567857:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081678.567893:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10f5dfaa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789081678.568169:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821298304 00000100:00100000:3.0:1789081678.568185:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821298304 00000100:00100000:3.0:1789081678.568256:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789081678.568268:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5793:x1875987821298304:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789081678.568623:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5793:x1875987821298304:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 356us (765us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789081678.568630:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789081678.572404:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff647b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5793:1875987821298304:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789081678.572518:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1789081678.572605:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fe89 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.572616:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fe89 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.572625:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fe89 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.572630:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998800 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081678.572635:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fe89 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.572643:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fe89 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.572658:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e10d046fe00) 00010000:00010000:0.0:1789081678.572661:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789081678.572665:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fe89 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.572671:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d5fe89 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789081678.572863:0:5793:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789081678.572950:0:5793:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1789081678.572959:0:5793:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 345455434943ns, next at 346455433318ns, rc = 0 00000001:00080000:0.0:1789081678.572966:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:0.0:1789081678.573006:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e10d046fe00) 00010000:00010000:0.0:1789081678.573009:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789081678.573016:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d5fe74 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9a7 expref: 46 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081678.573122:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b67050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+45:10501:x1875987796116992:12345-192.168.201.17@tcp:35:lfs.0 Request processed in 17052us (21007us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1789081678.573132:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 26 00000020:00080000:0.0:1789081678.573138:0:5793:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789081678.585142:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081678.585228:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796117248 00000100:00100000:0.0:1789081678.585245:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796117248 00000100:00100000:0.0:1789081678.585326:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 100 00000100:00100000:0.0:1789081678.585337:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+45:10501:x1875987796117248:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:0.0:1789081678.585364:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081678.585391:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d5fe90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a9ae expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.585472:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d5fe90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9ae expref: 46 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.585489:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d5fe90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9ae expref: 46 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.585569:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e10d19d3700) 00010000:00010000:0.0:1789081678.585573:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789081678.585576:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101983800, rc 0) 00000100:00100000:0.0:1789081678.585640:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+46:10501:x1875987796117248:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 305us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081678.585648:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 100 00000100:00100000:1.0:1789081678.592183:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081678.592351:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796117504 00000100:00100000:2.0:1789081678.592364:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796117504 00000100:00100000:2.0:1789081678.592446:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 27 00000100:00100000:2.0:1789081678.592476:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5dda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+46:10501:x1875987796117504:12345-192.168.201.17@tcp:35:lfs.0 00000100:00100000:2.0:1789081678.592855:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5dda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+47:10501:x1875987796117504:12345-192.168.201.17@tcp:35:lfs.0 Request processed in 381us (686us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1789081678.592864:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 27 00010000:00010000:2.0:1789081678.621951:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789081678.662218:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081678.662377:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796117632 00000100:00100000:3.0:1789081678.662392:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796117632 00000100:00100000:3.0:1789081678.662478:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 101 00000100:00100000:3.0:1789081678.662488:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+47:10511:x1875987796117632:12345-192.168.201.17@tcp:34:lfs.0 00010000:00010000:3.0:1789081678.662631:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5fe97 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.662665:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5fe97 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.662708:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5fe97 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.662729:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d5fe9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.662737:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d5fe9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.662744:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d5fe9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.662883:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fea5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.662898:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fea5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.662905:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fea5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789081678.662960:0:9245:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fea5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.663615:0:9245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5fe97 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.663623:0:9245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5fe97 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.663631:0:9245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5fe97 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.664110:0:9245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999e00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081678.664118:0:9245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5fe97 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.664129:0:9245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5fe97 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.664148:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e10d19d3a00) 00010000:00010000:3.0:1789081678.664151:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081678.664156:0:9245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5fe97 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.664163:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5fe97 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.664184:0:9245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d5fe9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.664191:0:9245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d5fe9e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.664198:0:9245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d5fe9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.664203:0:9245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998200 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081678.664206:0:9245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d5fe9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.664213:0:9245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d5fe9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.664299:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e10d046f900) 00010000:00010000:3.0:1789081678.664302:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081678.664305:0:9245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d5fe9e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.664311:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d5fe9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.664329:0:9245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fea5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.664336:0:9245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fea5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.664341:0:9245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fea5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.664347:0:9245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999000 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081678.664350:0:9245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fea5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.664356:0:9245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fea5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.664364:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e10d19d3700) 00010000:00010000:3.0:1789081678.664366:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081678.664369:0:9245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fea5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.664375:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5fea5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081678.664959:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+47:10511:x1875987796117632:12345-192.168.201.17@tcp:34:lfs.0 Request processed in 2465us (2750us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081678.664973:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 101 00000100:00100000:3.0:1789081678.710093:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081678.710188:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796117888 00000100:00100000:0.0:1789081678.710202:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796117888 00000100:00100000:0.0:1789081678.710308:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 102 00000100:00100000:0.0:1789081678.710321:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+47:10514:x1875987796117888:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:0.0:1789081678.710353:0:7252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081678.710384:0:7252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5feac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a9b5 expref: -99 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.710484:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5feb3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.710502:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5feb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.710516:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5feb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.710584:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5feba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.710592:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5feba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.710633:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5feba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.711277:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775400/0xb7cb3d7479d5fec1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.711290:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775400/0xb7cb3d7479d5fec1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.711298:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775400/0xb7cb3d7479d5fec1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789081678.711310:0:7252:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789081678.711428:0:7252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5feb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.711436:0:7252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5feb3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.711445:0:7252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5feb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.711450:0:7252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101983000 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081678.711455:0:7252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5feb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.711474:0:7252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5feb3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.711489:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e10d19d3a00) 00010000:00010000:2.0:1789081678.711492:0:7252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081678.711496:0:7252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5feb3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.711503:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d5feb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.711521:0:7252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5feba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.711571:0:7252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5feba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.711577:0:7252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5feba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.711583:0:7252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101983400 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081678.711585:0:7252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5feba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.711591:0:7252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5feba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.711598:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e10d19d3000) 00010000:00010000:2.0:1789081678.711600:0:7252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081678.711603:0:7252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5feba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.712019:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d5feba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.712083:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5feac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9b5 expref: 50 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.712098:0:7252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775400/0xb7cb3d7479d5fec1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9b5 expref: 49 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.712107:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e10d19d3700) 00010000:00010000:2.0:1789081678.712110:0:7252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789081678.712112:0:7252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101775400, rc 0) 00000100:00100000:2.0:1789081678.712218:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+49:10514:x1875987796117888:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 1899us (2140us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1789081678.712271:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 102 00000100:00100000:1.0:1789081678.722328:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081678.722579:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796118016 00000100:00100000:0.0:1789081678.722594:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796118016 00000100:00100000:0.0:1789081678.722690:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 103 00000100:00100000:0.0:1789081678.722702:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+49:10514:x1875987796118016:12345-192.168.201.17@tcp:54:lfs.0 00010000:00010000:0.0:1789081678.722815:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5fecf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.722836:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5fecf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.722849:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5fecf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.722886:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5fecf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.722894:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5fecf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.722901:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5fecf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.722908:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101983c00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081678.722914:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5fecf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.722922:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5fecf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.722956:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e10d19d3700) 00010000:00010000:0.0:1789081678.722959:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789081678.722965:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5fecf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.722972:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5fecf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081678.723082:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+49:10514:x1875987796118016:12345-192.168.201.17@tcp:54:lfs.0 Request processed in 381us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081678.723091:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 103 00000100:00100000:0.0:1789081678.726513:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081678.727156:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796118272 00000100:00100000:2.0:1789081678.727172:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796118272 00000100:00100000:2.0:1789081678.727255:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 28 00000100:00100000:2.0:1789081678.727268:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+49:10514:x1875987796118272:12345-192.168.201.17@tcp:35:lfs.0 00000100:00100000:2.0:1789081678.727601:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+50:10514:x1875987796118272:12345-192.168.201.17@tcp:35:lfs.0 Request processed in 335us (1102us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1789081678.727609:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 28 00000100:00100000:3.0:1789081678.813627:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081678.814017:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796118528 00000100:00100000:2.0:1789081678.814031:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796118528 00000100:00100000:2.0:1789081678.814112:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 104 00000100:00100000:2.0:1789081678.814123:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+50:10524:x1875987796118528:12345-192.168.201.17@tcp:101:bash.0 00010000:00010000:2.0:1789081678.814176:0:9245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081678.814181:0:9245:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789081678.814219:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5fe51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a999 expref: 50 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.814253:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e10d19d3a00) 00010000:00010000:2.0:1789081678.814260:0:9245:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789081678.814277:0:9245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774200/0xb7cb3d7479d5fed6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a9bc expref: -99 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.814405:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fedd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.814421:0:9245:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775400/0xb7cb3d7479d5fec1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9b5 expref: 50 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.814430:0:9245:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fedd lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.814478:0:9245:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775400/0xb7cb3d7479d5fec1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9b5 expref: 50 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.814493:0:9245:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775400/0xb7cb3d7479d5fec1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9b5 expref: 50 pid: 7252 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081678.814510:0:9245:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101b15500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9245:1875987821298432:192.168.201.17@tcp:104: 00000100:00100000:2.0:1789081678.814691:0:9245:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c53f70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789081678.820031:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081678.820176:0:9245:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101b15500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9245:1875987821298432:192.168.201.17@tcp:104: 00010000:00010000:2.0:1789081678.820252:0:9245:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fedd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081678.820401:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796118656 00000100:00100000:0.0:1789081678.820412:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796118656 00010000:00010000:0.0:1789081678.820466:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775400/0xb7cb3d7479d5fec1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9b5 expref: 51 pid: 7252 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081678.820518:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 52 00000100:00100000:0.0:1789081678.820581:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41476931-e751-413e-b98c-64d4d0edcd05+51:2351:x1875987796118656:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789081678.820601:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789081678.820609:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775400/0xb7cb3d7479d5fec1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9b5 expref: 51 pid: 7252 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.820624:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775400/0xb7cb3d7479d5fec1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9b5 expref: 51 pid: 7252 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.820654:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775400/0xb7cb3d7479d5fec1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9b5 expref: 51 pid: 7252 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.820682:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e10d19d3700) 00010000:00010000:0.0:1789081678.820688:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fedd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.820699:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fedd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.820708:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fedd lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.820738:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789081678.820805:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41476931-e751-413e-b98c-64d4d0edcd05+50:2351:x1875987796118656:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 227us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081678.820813:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 52 00010000:00010000:2.0:1789081678.820878:0:9245:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fedd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.820886:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fedd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789081678.820912:0:9245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789081678.821128:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774200/0xb7cb3d7479d5fed6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9bc expref: 51 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.821146:0:9245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fedd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9bc expref: 50 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.821154:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e10d19d3700) 00010000:00010000:2.0:1789081678.821156:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789081678.821159:0:9245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101774a00, rc 0) 00000100:00100000:2.0:1789081678.821191:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+50:10524:x1875987796118528:12345-192.168.201.17@tcp:101:bash.0 Request processed in 7070us (7591us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1789081678.821199:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 104 00000100:00100000:0.0:1789081678.825782:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081678.826020:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796118912 00000100:00100000:2.0:1789081678.826034:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796118912 00000100:00100000:2.0:1789081678.826145:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 105 00000100:00100000:2.0:1789081678.826158:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+50:10524:x1875987796118912:12345-192.168.201.17@tcp:36:bash.0 00010000:00010000:2.0:1789081678.826508:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d5feeb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.826594:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d5feeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.826664:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d5feeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789081678.826727:0:7252:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967394 00000004:00010000:2.0:1789081678.826755:0:7252:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000026839e1 reply state 000000009e7e8c22 transno 4294967395 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d5feeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081678.826765:0:7252:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789081678.826946:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+53:10524:x1875987796118912:12345-192.168.201.17@tcp:36:bash.0 Request processed in 790us (1178us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1789081678.826954:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 105 00000020:00080000:2.0:1789081678.826960:0:7252:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789081678.829133:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d5feeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.829155:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d5feeb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.829164:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d5feeb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.829171:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101774800 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081678.829177:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d5feeb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.829185:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d5feeb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.829206:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e10d19d3700) 00010000:00010000:3.0:1789081678.829210:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081678.829216:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d5feeb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.829223:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d5feeb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081678.829891:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081678.831009:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796119040 00000100:00100000:0.0:1789081678.831027:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796119040 00000100:00100000:0.0:1789081678.831113:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 106 00000100:00100000:0.0:1789081678.831126:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff700380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+52:10524:x1875987796119040:12345-192.168.201.17@tcp:101:bash.0 00010000:00010000:0.0:1789081678.831159:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081678.831190:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5fef2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a9c3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.831314:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fef9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.831332:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fedd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9bc expref: 53 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.831369:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fef9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.831416:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fedd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9bc expref: 53 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.831432:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fedd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9bc expref: 53 pid: 9245 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081678.831451:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff646300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5790:1875987821298560:192.168.201.17@tcp:104: 00000100:00100000:0.0:1789081678.831678:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10f5dfac00 going to sleep for 11 seconds 00000100:00100000:3.0:1789081678.835068:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081678.835116:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796119168 00000100:00100000:3.0:1789081678.835136:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796119168 00010000:00010000:3.0:1789081678.835190:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fedd lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9bc expref: 54 pid: 9245 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081678.835251:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 53 00000100:00100000:3.0:1789081678.835262:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5a69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41476931-e751-413e-b98c-64d4d0edcd05+54:2351:x1875987796119168:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789081678.835282:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081678.835291:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fedd lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9bc expref: 54 pid: 9245 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.835307:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fedd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9bc expref: 54 pid: 9245 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.835337:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e10d19d3700) 00010000:00010000:3.0:1789081678.835343:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fef9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.835356:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.835366:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fef9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.835391:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789081678.835456:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5a69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41476931-e751-413e-b98c-64d4d0edcd05+54:2351:x1875987796119168:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 196us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081678.835464:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 53 00010000:00010000:0.0:1789081678.836260:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d5fedd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9bc expref: 53 pid: 9245 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081678.836289:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff646300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5790:1875987821298560:192.168.201.17@tcp:104: 00010000:00010000:0.0:1789081678.836322:0:5790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.836331:0:5790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.836338:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789081678.836400:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789081678.836405:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789081678.836435:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.836492:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5fef2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9c3 expref: 53 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.836509:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fef9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9c3 expref: 52 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.836518:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e10d19d3700) 00010000:00010000:0.0:1789081678.836520:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789081678.836541:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101982600, rc 0) 00000100:00100000:0.0:1789081678.836598:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff700380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+52:10524:x1875987796119040:12345-192.168.201.17@tcp:101:bash.0 Request processed in 5476us (6716us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081678.837436:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 106 00000100:00100000:3.0:1789081678.841069:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081678.841196:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796119424 00000100:00100000:2.0:1789081678.841211:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796119424 00000100:00100000:2.0:1789081678.841293:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 29 00000100:00100000:2.0:1789081678.841305:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5a6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+52:10524:x1875987796119424:12345-192.168.201.17@tcp:35:bash.0 00000100:00100000:2.0:1789081678.841666:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5a6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+53:10524:x1875987796119424:12345-192.168.201.17@tcp:35:bash.0 Request processed in 362us (609us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1789081678.841674:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 29 00000100:00100000:3.0:1789081678.911472:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081678.911737:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796119552 00000100:00100000:2.0:1789081678.911750:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796119552 00000100:00100000:2.0:1789081678.911835:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 107 00000100:00100000:2.0:1789081678.911847:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5a6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+53:10530:x1875987796119552:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:2.0:1789081678.911881:0:9245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081678.911917:0:9245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774200/0xb7cb3d7479d5ff00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a9ca expref: -99 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.912023:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d5ff07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.912042:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d5ff07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.912055:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d5ff07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789081678.912136:0:9245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1789081678.912140:0:9245:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1789081678.912167:0:9245:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d5ff07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.912198:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774200/0xb7cb3d7479d5ff00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9ca expref: 55 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.912233:0:9245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d5ff07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9ca expref: 54 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.912244:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e10d19d3a00) 00010000:00010000:2.0:1789081678.912247:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789081678.912251:0:9245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101774600, rc 0) 00000100:00100000:2.0:1789081678.912330:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5a6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+54:10530:x1875987796119552:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 485us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081678.912338:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 107 00000100:00100000:3.0:1789081678.916153:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081678.916348:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796119680 00000100:00100000:0.0:1789081678.916363:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796119680 00000100:00100000:0.0:1789081678.916478:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 108 00000100:00100000:0.0:1789081678.916490:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5a69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+54:10530:x1875987796119680:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:0.0:1789081678.916517:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081678.916590:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d5ff0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a9d1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.916693:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5ff15 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.916712:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5ff15 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.916726:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5ff15 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.916764:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5ff1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.916773:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5ff1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.916780:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5ff1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.916932:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5ff23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.916942:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5ff23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.916949:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5ff23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789081678.917005:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789081678.917012:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789081678.917036:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5ff23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.917050:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5ff23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.917058:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5ff15 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.917064:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5ff15 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.917081:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5ff15 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.917087:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101982e00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081678.917092:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5ff15 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.917100:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5ff15 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.917115:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e10d19d3a00) 00010000:00010000:0.0:1789081678.917118:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081678.917124:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5ff15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.917130:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5ff15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.917144:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5ff1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.917150:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5ff1c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.917155:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5ff1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.917159:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101982200 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081678.917162:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5ff1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.917175:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5ff1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.917183:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e10d19d3600) 00010000:00010000:0.0:1789081678.917185:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081678.917188:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5ff1c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.917193:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5ff1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.917243:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d5ff0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9d1 expref: 56 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.917258:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5ff23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9d1 expref: 55 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.917265:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e10d19d3700) 00010000:00010000:0.0:1789081678.917268:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789081678.917270:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101983c00, rc 0) 00000100:00100000:0.0:1789081678.917566:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5a69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+55:10530:x1875987796119680:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 1076us (1427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081678.917576:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 108 00000100:00100000:0.0:1789081678.924336:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081678.924464:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081678.924573:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796120064 00000100:00100000:3.0:1789081678.924588:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796120064 00000100:00100000:3.0:1789081678.924682:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 7 00000100:00100000:3.0:1789081678.924694:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff645c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41476931-e751-413e-b98c-64d4d0edcd05+55:2350:x1875987796120064:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789081678.924713:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081678.924747:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d5ff23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9d1 expref: 55 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.924772:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e10d19d3700) 00010000:00010000:3.0:1789081678.924778:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789081678.925039:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff645c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41476931-e751-413e-b98c-64d4d0edcd05+54:2350:x1875987796120064:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 346us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081678.925047:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 7 00000100:00100000:1.0:1789081678.925200:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796119936 00000100:00100000:1.0:1789081678.925206:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796119936 00000100:00100000:1.0:1789081678.925377:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 109 00000100:00100000:1.0:1789081678.925386:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+54:10530:x1875987796119936:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:1.0:1789081678.925410:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081678.925433:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5ff2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a9d8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.925586:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d5ff31 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.925610:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fef9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9c3 expref: 55 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.925639:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d5ff31 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.925681:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fef9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9c3 expref: 55 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.925696:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fef9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9c3 expref: 55 pid: 5790 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081678.925712:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5dd8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5791:1875987821298688:192.168.201.17@tcp:104: 00000100:00100000:1.0:1789081678.925932:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c4c54e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789081678.929270:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081678.929391:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5dd8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5791:1875987821298688:192.168.201.17@tcp:104: 00010000:00010000:1.0:1789081678.929429:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d5ff31 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081678.929516:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796120192 00000100:00100000:2.0:1789081678.929584:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796120192 00010000:00010000:2.0:1789081678.929648:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fef9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9c3 expref: 56 pid: 5790 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081678.929691:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 54 00000100:00100000:2.0:1789081678.929702:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c9389450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41476931-e751-413e-b98c-64d4d0edcd05+56:2351:x1875987796120192:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789081678.929723:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789081678.929731:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fef9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9c3 expref: 56 pid: 5790 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.929744:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fef9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9c3 expref: 56 pid: 5790 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.929772:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d5fef9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9c3 expref: 56 pid: 5790 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.929802:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e10d19d3700) 00010000:00010000:2.0:1789081678.929809:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d5ff31 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.929819:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d5ff31 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.929828:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d5ff31 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081678.929851:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789081678.929921:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c9389450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41476931-e751-413e-b98c-64d4d0edcd05+55:2351:x1875987796120192:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 220us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081678.929938:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 54 00010000:00010000:1.0:1789081678.930458:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d5ff31 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.930467:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d5ff31 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789081678.930494:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789081678.930743:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5ff2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9d8 expref: 56 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.930765:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d5ff31 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9d8 expref: 55 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081678.930799:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e10d19d3700) 00010000:00010000:1.0:1789081678.930803:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789081678.930807:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13ae600, rc 0) 00000100:00100000:1.0:1789081678.930856:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+55:10530:x1875987796119936:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 5471us (6534us total) trans 4294967397 rc 0/0 00000100:00100000:1.0:1789081678.930865:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 109 00000100:00100000:3.0:1789081678.935205:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081678.935361:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796120448 00000100:00100000:0.0:1789081678.935374:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796120448 00000100:00100000:0.0:1789081678.935462:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 8 00000100:00100000:0.0:1789081678.935495:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5a68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41476931-e751-413e-b98c-64d4d0edcd05+55:10530:x1875987796120448:12345-192.168.201.17@tcp:103:lfs.0 00010000:00010000:0.0:1789081678.935518:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789081678.935600:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d5fe90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9ae expref: 55 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.935639:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e10d19d3700) 00010000:00010000:0.0:1789081678.935646:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789081678.935731:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5a68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41476931-e751-413e-b98c-64d4d0edcd05+54:10530:x1875987796120448:12345-192.168.201.17@tcp:103:lfs.0 Request processed in 239us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081678.935740:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 8 00000100:00100000:2.0:1789081678.938266:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081678.938383:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796120576 00000100:00100000:3.0:1789081678.938396:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796120576 00000100:00100000:3.0:1789081678.938470:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 110 00000100:00100000:3.0:1789081678.938481:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+54:10530:x1875987796120576:12345-192.168.201.17@tcp:58:lfs.0 00010000:00010000:3.0:1789081678.938657:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d5ff3f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.938682:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d5ff3f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081678.938697:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d5ff3f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789081678.939045:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1789081678.939165:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+54:10530:x1875987796120576:12345-192.168.201.17@tcp:58:lfs.0 Request processed in 685us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081678.939174:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 110 00000100:00100000:2.0:1789081678.942297:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081678.942386:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796120704 00000100:00100000:0.0:1789081678.942401:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796120704 00000100:00100000:0.0:1789081678.942484:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 111 00000100:00100000:0.0:1789081678.942497:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+54:10530:x1875987796120704:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:0.0:1789081678.942558:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081678.942590:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5ff46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a9df expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.942682:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d5ff3f lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.942695:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5ff46 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9df expref: 55 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.942718:0:5790:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d5ff3f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.942733:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5ff46 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9df expref: 55 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.942770:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e10d19d3700) 00010000:00010000:0.0:1789081678.942774:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789081678.942778:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5ff46 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9df expref: 55 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081678.942785:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101982200, rc 0) 00000100:00100000:0.0:1789081678.942871:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+55:10530:x1875987796120704:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 378us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081678.942879:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 111 00000040:00080000:3.0:1789081679.197236:0:11539:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789081679.197249:0:11539:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789081679.197312:0:11539:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1789081679.197320:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789081679.197490:0:11539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5a68e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11539:1875987821298816:192.168.201.17@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789081679.198278:0:11539:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c539fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789081679.204573:0:11539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5a68e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11539:1875987821298816:192.168.201.17@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789081679.212850:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081679.213040:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796120832 00000100:00100000:0.0:1789081679.213056:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796120832 00000100:00100000:0.0:1789081679.213157:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 112 00000100:00100000:0.0:1789081679.213171:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5a68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+55:10531:x1875987796120832:12345-192.168.201.17@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789081679.213218:0:5789:0:(mdt_handler.c:8081:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789081679.213376:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5a68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+55:10531:x1875987796120832:12345-192.168.201.17@tcp:53:lhsmtool_posix.0 Request processed in 209us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081679.213385:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 112 00000100:00080000:3.0:1789081679.213693:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789081679.222391:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081679.222509:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796120960 00000100:00100000:1.0:1789081679.222798:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796120960 00000100:00100000:1.0:1789081679.222881:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 113 00000100:00100000:1.0:1789081679.222893:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+55:10531:x1875987796120960:12345-192.168.201.17@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789081679.223030:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5ff4d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.223054:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5ff4d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.223070:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5ff4d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.223089:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5ff54 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.223098:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5ff54 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.223105:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5ff54 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.223162:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5ff5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.223173:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5ff5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.223180:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5ff5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789081679.223232:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789081679.223238:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789081679.223255:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5ff5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.223267:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5ff4d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.223492:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5ff4d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.223502:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5ff4d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.224355:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13af400 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081679.224362:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5ff4d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.224375:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5ff4d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.224394:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e10d046fc00) 00010000:00010000:1.0:1789081679.224410:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789081679.224416:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5ff4d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.224423:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5ff4d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.224445:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5ff54 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.224451:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5ff54 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.224458:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5ff54 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.224463:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13af600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081679.224466:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5ff54 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.224473:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5ff54 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.224481:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9e10c7ecf800) 00010000:00010000:1.0:1789081679.224484:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789081679.224487:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5ff54 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.224492:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5ff54 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.224510:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5ff5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.225151:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5ff5b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.225162:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5ff5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.225169:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13aee00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081679.225173:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5ff5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.225180:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5ff5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.225189:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e10d19d3700) 00010000:00010000:1.0:1789081679.225193:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789081679.225196:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5ff5b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.225202:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5ff5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081679.225420:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+55:10531:x1875987796120960:12345-192.168.201.17@tcp:34:lhsmtool_posix.0 Request processed in 2522us (3037us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081679.225431:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 113 00000100:00100000:1.0:1789081679.228478:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081679.229270:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796121216 00000100:00100000:2.0:1789081679.229361:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796121216 00000100:00100000:2.0:1789081679.229449:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 114 00000100:00100000:2.0:1789081679.229463:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+55:10531:x1875987796121216:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789081679.229492:0:9245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081679.229570:0:9245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d5ff62 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a9e6 expref: -99 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.229706:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d5ff69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.229727:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d5ff69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.229742:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d5ff69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789081679.229757:0:9245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789081679.229890:0:9245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d5ff69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.229899:0:9245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d5ff69 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.229907:0:9245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d5ff69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.229932:0:9245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101775600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081679.229938:0:9245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d5ff69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.229946:0:9245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d5ff69 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.229962:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e10d19d3700) 00010000:00010000:2.0:1789081679.229965:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789081679.229971:0:9245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d5ff69 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.229991:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d5ff69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.230047:0:9245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d5ff62 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9e6 expref: 57 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.230059:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e10d046fc00) 00010000:00010000:2.0:1789081679.230061:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789081679.230065:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d5ff62 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9e6 expref: 57 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.230076:0:9245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101775c00, rc 0) 00000100:00100000:2.0:1789081679.230165:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+56:10531:x1875987796121216:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 704us (1700us total) trans 4294967398 rc 301/301 00000100:00100000:2.0:1789081679.230173:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 114 00000100:00100000:3.0:1789081679.233777:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081679.233938:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796121344 00000100:00100000:2.0:1789081679.233970:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796121344 00000100:00100000:2.0:1789081679.234061:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 115 00000100:00100000:2.0:1789081679.234072:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+56:10531:x1875987796121344:12345-192.168.201.17@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789081679.234126:0:7252:0:(mdt_handler.c:8081:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789081679.234280:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+56:10531:x1875987796121344:12345-192.168.201.17@tcp:53:lhsmtool_posix.0 Request processed in 209us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081679.234289:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 115 00000100:00100000:3.0:1789081679.237911:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081679.238053:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796121600 00000100:00100000:1.0:1789081679.238068:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796121600 00000100:00100000:1.0:1789081679.238149:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 116 00000100:00100000:1.0:1789081679.238163:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5a68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+56:10531:x1875987796121600:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789081679.238211:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081679.238216:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789081679.238254:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d5ff07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9ca expref: 56 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.238289:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e10d19d3a00) 00010000:00010000:1.0:1789081679.238297:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789081679.238317:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5ff77 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a9ed expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789081679.238953:0:5791:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1789081679.239212:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5ff7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.239231:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5ff7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.239244:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5ff7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.239313:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5ff77 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9ed expref: 58 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.239332:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5ff7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9ed expref: 57 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.239340:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e10c7ecf800) 00010000:00010000:1.0:1789081679.239343:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789081679.239358:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13af600, rc 0) 00000100:00100000:1.0:1789081679.239456:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5a68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+57:10531:x1875987796121600:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 1296us (1558us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1789081679.239465:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 116 00000100:00100000:0.0:1789081679.242634:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081679.242771:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796121856 00000100:00100000:3.0:1789081679.242786:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796121856 00000100:00100000:3.0:1789081679.242878:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 117 00000100:00100000:3.0:1789081679.242892:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+57:10531:x1875987796121856:12345-192.168.201.17@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789081679.242972:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081679.243022:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d5ff7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9ed expref: 57 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.243047:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e10c7ecf800) 00010000:00010000:3.0:1789081679.243060:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789081679.243109:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5ff8c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.243127:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5ff8c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.243139:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5ff8c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.243412:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5ff93 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x3781a80f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.243436:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5ff93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3781a80f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.243450:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5ff93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3781a80f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.243932:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5ff8c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.243942:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5ff8c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.243949:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5ff8c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.243954:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999000 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081679.243958:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5ff8c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.243965:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5ff8c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.244005:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e10d19d3a00) 00010000:00010000:3.0:1789081679.244008:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081679.244013:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5ff8c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.244019:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d5ff8c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.246479:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5ff93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3781a80f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.246902:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5ff93 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3781a80f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.246910:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5ff93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3781a80f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.246917:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999e00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081679.246922:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5ff93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3781a80f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.246930:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5ff93 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3781a80f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.246948:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x3781a80f (ffff9e10d046f900) 00010000:00010000:3.0:1789081679.246951:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081679.246955:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5ff93 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x3781a80f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.246961:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5ff93 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x3781a80f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081679.247965:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+56:10531:x1875987796121856:12345-192.168.201.17@tcp:36:lhsmtool_posix.0 Request processed in 5067us (5337us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789081679.247976:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 117 00000100:00100000:3.0:1789081679.253446:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081679.254280:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796121984 00000100:00100000:0.0:1789081679.254297:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796121984 00000100:00100000:0.0:1789081679.254398:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 118 00000100:00100000:0.0:1789081679.254410:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5a68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+56:10531:x1875987796121984:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789081679.254457:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081679.254490:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5ff9a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a9f4 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.254579:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5ffa1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.254786:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5ffa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.254805:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5ffa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.254933:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d5ff9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9f4 expref: 58 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.254957:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5ffa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9f4 expref: 57 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.254968:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e10d19d3600) 00010000:00010000:0.0:1789081679.254971:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789081679.254976:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101982000, rc 0) 00000100:00100000:0.0:1789081679.255075:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5a68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+57:10531:x1875987796121984:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 666us (1642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081679.255084:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 118 00000100:00100000:3.0:1789081679.258200:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081679.258401:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796122240 00000100:00100000:1.0:1789081679.258415:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796122240 00000100:00100000:1.0:1789081679.258509:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 119 00000100:00100000:1.0:1789081679.258569:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5a69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+57:10531:x1875987796122240:12345-192.168.201.17@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789081679.258735:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5ffa8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.258756:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5ffa8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.258771:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5ffa8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789081679.259127:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:1.0:1789081679.259140:0:5791:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 346141615436ns, next at 347141611624ns, rc = 0 00000004:00010000:1.0:1789081679.259262:0:5791:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000061987246 reply state 00000000960e843a transno 4294967400 ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5ffa8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081679.259289:0:5791:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789081679.259429:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5a69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+59:10531:x1875987796122240:12345-192.168.201.17@tcp:36:lhsmtool_posix.0 Request processed in 906us (1240us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1789081679.259438:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 119 00000100:00100000:2.0:1789081679.266340:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081679.266472:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796122368 00000100:00100000:1.0:1789081679.266485:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796122368 00000100:00100000:1.0:1789081679.266608:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 120 00000100:00100000:1.0:1789081679.266620:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d16c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+59:10531:x1875987796122368:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789081679.266665:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081679.266695:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5ffaf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2a9fb expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.266776:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5ffaf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9fb expref: 60 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.266793:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5ffaf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9fb expref: 60 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.266814:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e10d19d3600) 00010000:00010000:1.0:1789081679.266818:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789081679.266822:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13af400, rc 0) 00000100:00100000:1.0:1789081679.266897:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d16c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+60:10531:x1875987796122368:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 279us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081679.266904:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 120 00010000:00010000:0.0:1789081679.267161:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5ffa8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.267172:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5ffa8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.267188:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5ffa8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.267195:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13aee00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081679.267200:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5ffa8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.267210:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5ffa8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.267223:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e10d19d3600) 00010000:00010000:0.0:1789081679.267226:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789081679.267229:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5ffa8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.267236:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d5ffa8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081679.279400:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081679.279593:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796122496 00000100:00100000:0.0:1789081679.279610:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796122496 00000100:00080000:3.0:1789081679.279694:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789081679.279715:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 37 00000100:00100000:0.0:1789081679.279731:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5a6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41476931-e751-413e-b98c-64d4d0edcd05+8:2351:x1875987796122496:12345-192.168.201.17@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789081679.280145:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5a6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41476931-e751-413e-b98c-64d4d0edcd05+9:2351:x1875987796122496:12345-192.168.201.17@tcp:2:lhsmtool_posix.0 Request processed in 418us (757us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789081679.280155:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 37 00000100:00100000:3.0:1789081679.283607:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081679.284046:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796122752 00000100:00100000:2.0:1789081679.284060:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796122752 00000100:00100000:2.0:1789081679.284144:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 30 00000100:00100000:2.0:1789081679.284156:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5a6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+59:10531:x1875987796122752:12345-192.168.201.17@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789081679.284473:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5a6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+60:10531:x1875987796122752:12345-192.168.201.17@tcp:35:lhsmtool_posix.0 Request processed in 318us (884us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1789081679.284483:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 30 00000100:00100000:2.0:1789081679.288293:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081679.288420:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796123008 00000100:00100000:0.0:1789081679.288435:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796123008 00000100:00100000:0.0:1789081679.288572:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 121 00000100:00100000:0.0:1789081679.288586:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d16c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+60:10531:x1875987796123008:12345-192.168.201.17@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789081679.288767:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d16c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+60:10531:x1875987796123008:12345-192.168.201.17@tcp:57:lhsmtool_posix.0 Request processed in 183us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081679.288776:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 121 00000100:00100000:3.0:1789081679.292636:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081679.296173:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796123136 00000100:00100000:2.0:1789081679.296197:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796123136 00000100:00100000:2.0:1789081679.296308:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 122 00000100:00100000:2.0:1789081679.296323:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5a69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+60:10531:x1875987796123136:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789081679.296355:0:7252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081679.296385:0:7252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d5ffb6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2aa02 expref: -99 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.296485:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775200/0xb7cb3d7479d5ffbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.296578:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775200/0xb7cb3d7479d5ffbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.296593:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775200/0xb7cb3d7479d5ffbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789081679.296641:0:7252:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789081679.296663:0:7252:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775200/0xb7cb3d7479d5ffbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.296696:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d5ffb6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa02 expref: 62 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.296719:0:7252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775200/0xb7cb3d7479d5ffbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa02 expref: 61 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.296729:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e10d19d3600) 00010000:00010000:2.0:1789081679.296732:0:7252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789081679.296737:0:7252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101775200, rc 0) 00000100:00100000:2.0:1789081679.296828:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5a69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+61:10531:x1875987796123136:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 509us (4206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081679.296837:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 122 00000100:00100000:3.0:1789081679.302415:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081679.302593:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796123264 00000100:00100000:1.0:1789081679.302613:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796123264 00000100:00100000:1.0:1789081679.302869:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 38 00000100:00100000:1.0:1789081679.302883:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5a68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41476931-e751-413e-b98c-64d4d0edcd05+9:2348:x1875987796123264:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789081679.302911:0:6582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081679.302941:0:6582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016ccea44/0xb7cb3d7479d5ffc4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2aa09 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789081679.302975:0:6582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3384f, blocks: 0x1 00010000:00010000:1.0:1789081679.303017:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=346s v=(0 0) 00010000:00010000:1.0:1789081679.303039:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789081679.303052:0:6582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016ccea44/0xb7cb3d7479d5ffc4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa09 expref: 10 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.303075:0:6582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000016ccea44/0xb7cb3d7479d5ffc4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa09 expref: 10 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.303103:0:6582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13aee00, rc 0) 00000100:00100000:1.0:1789081679.303300:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5a68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41476931-e751-413e-b98c-64d4d0edcd05+10:2348:x1875987796123264:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 419us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081679.303308:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 38 00000100:00100000:0.0:1789081679.310585:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081679.310759:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796123520 00000100:00100000:1.0:1789081679.310774:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796123520 00000100:00100000:1.0:1789081679.310854:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 123 00000100:00100000:1.0:1789081679.310866:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+61:10531:x1875987796123520:12345-192.168.201.17@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789081679.311035:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+61:10531:x1875987796123520:12345-192.168.201.17@tcp:57:lhsmtool_posix.0 Request processed in 171us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081679.311045:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 123 00000100:00100000:3.0:1789081679.318272:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081679.322319:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796123648 00000100:00100000:0.0:1789081679.322345:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796123648 00000100:00100000:1.0:1789081679.322590:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 39 00000100:00100000:1.0:1789081679.322613:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41476931-e751-413e-b98c-64d4d0edcd05+10:10531:x1875987796123648:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789081679.322639:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081679.322679:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cda72b71/0xb7cb3d7479d5ffcb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2aa10 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.322724:0:6581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000016ccea44/0xb7cb3d7479d5ffc4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa09 expref: 11 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.322756:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789081679.322761:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789081679.322768:0:6581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cda72b71/0xb7cb3d7479d5ffcb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa10 expref: 11 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.322946:0:6581:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000016ccea44/0xb7cb3d7479d5ffc4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa09 expref: 11 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.322964:0:6581:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000016ccea44/0xb7cb3d7479d5ffc4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa09 expref: 11 pid: 6582 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081679.323019:0:6581:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5ddaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6581:1875987821298944:192.168.201.17@tcp:104: 00000100:00100000:1.0:1789081679.323304:0:6581:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c4c54300 going to sleep for 11 seconds 00000100:00100000:3.0:1789081679.346615:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081679.346641:0:6581:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5ddaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6581:1875987821298944:192.168.201.17@tcp:104: 00000100:00100000:2.0:1789081679.346756:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796123776 00000100:00100000:2.0:1789081679.346766:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796123776 00010000:00010000:2.0:1789081679.346830:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000016ccea44/0xb7cb3d7479d5ffc4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa09 expref: 12 pid: 6582 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081679.346890:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 55 00010000:00010000:1.0:1789081679.347012:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cda72b71/0xb7cb3d7479d5ffcb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa10 expref: 12 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.347033:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13af600, rc 0) 00000100:00100000:2.0:1789081679.347358:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41476931-e751-413e-b98c-64d4d0edcd05+12:2351:x1875987796123776:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789081679.347378:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789081679.347411:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000016ccea44/0xb7cb3d7479d5ffc4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa09 expref: 12 pid: 6582 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.347427:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000016ccea44/0xb7cb3d7479d5ffc4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa09 expref: 12 pid: 6582 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.347459:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016ccea44/0xb7cb3d7479d5ffc4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa09 expref: 12 pid: 6582 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.347478:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789081679.347483:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789081679.347493:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cda72b71/0xb7cb3d7479d5ffcb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa10 expref: 11 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.347506:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cda72b71/0xb7cb3d7479d5ffcb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa10 expref: 11 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.347606:0:5776:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000cda72b71/0xb7cb3d7479d5ffcb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa10 expref: 11 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081679.347623:0:5776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d16c7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5776:1875987821299072:192.168.201.17@tcp:105: 00000100:00100000:1.0:1789081679.350034:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41476931-e751-413e-b98c-64d4d0edcd05+11:10531:x1875987796123648:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 26471us (30826us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081679.350052:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 39 00000100:00100000:2.0:1789081679.350447:0:5776:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c53f7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789081679.362476:0:5776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d16c7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5776:1875987821299072:192.168.201.17@tcp:105: 00010000:00010000:2.0:1789081679.362589:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789081679.362719:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41476931-e751-413e-b98c-64d4d0edcd05+10:2351:x1875987796123776:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 15366us (16120us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081679.362732:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 55 00000100:00100000:0.0:1789081679.389337:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081679.390109:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796123904 00000100:00100000:2.0:1789081679.390128:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796123904 00002000:00100000:2.0:1789081679.390213:0:6589:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9e10ff646d80 x1875987796123904/t0(0) o4->41476931-e751-413e-b98c-64d4d0edcd05@192.168.201.17@tcp:470/0 lens 504/0 e 0 to 0 dl 1789081690 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789081679.390226:0:6589:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e10ff646d80 with x1875987796123904 ext(0->12) 00002000:00010000:2.0:1789081679.390233:0:6589:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e10ff646d80 00000100:00100000:2.0:1789081679.390273:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 2 00000100:00100000:2.0:1789081679.390284:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff646d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41476931-e751-413e-b98c-64d4d0edcd05+10:2350:x1875987796123904:12345-192.168.201.17@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789081679.395569:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff646d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41476931-e751-413e-b98c-64d4d0edcd05+12:2350:x1875987796123904:12345-192.168.201.17@tcp:4:lhsmtool_posix.0 Request processed in 5270us (6243us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789081679.395589:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 2 00002000:00100000:2.0:1789081679.395606:0:6589:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9e10ff646d80 x1875987796123904/t4294967308(0) o4->41476931-e751-413e-b98c-64d4d0edcd05@192.168.201.17@tcp:470/0 lens 504/448 e 0 to 0 dl 1789081690 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789081679.395618:0:6589:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e10ff646d80 with x1875987796123904 ext(0->12) 00002000:00010000:2.0:1789081679.395626:0:6589:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e10ff646d80 00000100:00100000:3.0:1789081679.405890:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081679.406362:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796124032 00000100:00100000:1.0:1789081679.406374:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796124032 00000100:00100000:1.0:1789081679.406458:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 124 00000100:00100000:1.0:1789081679.406488:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5a69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+61:10531:x1875987796124032:12345-192.168.201.17@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789081679.533806:0:5811:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967389 is committed 00000004:00080000:0.0:1789081679.533825:0:5811:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1789081679.533858:0:5811:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e10d1a2e000 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1789081679.533865:0:5811:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e10d1b3d700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e10d1a2e900 00000020:00080000:0.0:1789081679.534368:0:5811:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e10d1b3d200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e10c8a2f400 00000020:00080000:2.0:1789081679.534406:0:5822:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000004:00080000:0.0:1789081679.534495:0:5811:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000001:00080000:0.0:1789081679.535290:0:5811:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1789081679.535298:0:5811:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000100:00100000:1.0:1789081679.535345:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789081679.535374:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821299200:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789081679.535482:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081679.535604:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821299200 00000100:00100000:1.0:1789081679.535615:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821299200 00000100:00100000:1.0:1789081679.535680:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789081679.535691:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3306:x1875987821299200:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789081679.535733:0:6584:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:1.0:1789081679.535783:0:6584:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa3384e, atime: 0x6aa3384e, ctime: 0x6aa3384e, blocks: 0x1 00010000:00010000:1.0:1789081679.535793:0:6584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a8b56ad/0xb7cb3d7479d5ffd2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.535828:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=346s v=(0 0) 00010000:00010000:1.0:1789081679.535834:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789081679.535843:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a8b56ad/0xb7cb3d7479d5ffd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.535863:0:6584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a8b56ad/0xb7cb3d7479d5ffd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.536336:0:6584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a8b56ad/0xb7cb3d7479d5ffd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.536347:0:6584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a8b56ad/0xb7cb3d7479d5ffd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.536405:0:6584:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789081679.537703:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789081679.537718:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a8b56ad/0xb7cb3d7479d5ffd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.537732:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13aec00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:3.0:1789081679.537738:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a8b56ad/0xb7cb3d7479d5ffd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.537749:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a8b56ad/0xb7cb3d7479d5ffd2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.537787:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a8b56ad/0xb7cb3d7479d5ffd2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.537796:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a8b56ad/0xb7cb3d7479d5ffd2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.537850:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081679.537853:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081679.537854:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789081679.538169:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3306:x1875987821299200:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2476us (2683us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789081679.538182:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:1.0:1789081679.538339:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e10ff645f80/2, rc 0, transno 4294967304 00000100:00100000:1.0:1789081679.538347:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821299200:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789081679.540731:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5a69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821299456:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789081679.540883:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081679.540991:0:7788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821299456 00000100:00100000:3.0:1789081679.541001:0:7788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821299456 00000100:00100000:3.0:1789081679.541075:0:7788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789081679.541085:0:7788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f98d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1875987821299456:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789081679.541705:0:7788:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789081679.541713:0:7788:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789081679 00002000:00010000:3.0:1789081679.541716:0:7788:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789081679.541719:0:7788:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789081679 -> 1789081679 00002000:00010000:3.0:1789081679.541721:0:7788:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789081679.542068:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789081679.542087:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5a6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821299328:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789081679.542132:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081679.542190:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821299328 00000100:00100000:2.0:1789081679.542195:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821299328 00000100:00100000:3.0:1789081679.542287:0:7788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f98d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3303:x1875987821299456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1202us (1403us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789081679.542297:0:7788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1789081679.542330:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789081679.542379:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e10f5a69180/2, rc 0, transno 4294967309 00000100:00100000:3.0:1789081679.542388:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5a69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821299456:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789081679.542586:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789081679.542595:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d16c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1875987821299328:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789081679.542629:0:6584:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:2.0:1789081679.542655:0:6584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc2efcf1/0xb7cb3d7479d5ffd9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.542683:0:6584:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4df4081/0xb7cb3d7479d5fd94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a96f expref: 11 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.542694:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1789081679.542700:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789081679.542706:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc2efcf1/0xb7cb3d7479d5ffd9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.542747:0:6584:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d4df4081/0xb7cb3d7479d5fd94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a96f expref: 11 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.542765:0:6584:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d4df4081/0xb7cb3d7479d5fd94 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a96f expref: 11 pid: 7788 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081679.546134:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5a69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+48:10531:x1875987796124032:12345-192.168.201.17@tcp:44:lhsmtool_posix.0 Request processed in 139632us (140247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081679.546154:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 124 00000100:00100000:2.0:1789081679.546558:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d16c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6584:1875987821299584:192.168.201.17@tcp:104: 00000020:00080000:0.0:1789081679.546727:0:5811:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:0.0:1789081679.546753:0:5811:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967401 is committed 00000100:00100000:2.0:1789081679.547999:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c9167a80 going to sleep for 11 seconds 00000020:00080000:0.0:1789081679.548322:0:5811:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e10c53f7780 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1789081679.548327:0:5811:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e10d035cc00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e10c53f7cc0 00000020:00080000:0.0:1789081679.548332:0:5811:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e10d035cf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e10f5752c00 00000020:00080000:0.0:1789081679.548947:0:5822:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1789081679.549268:0:5822:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1789081679.554651:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d16c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6584:1875987821299584:192.168.201.17@tcp:104: 00010000:00010000:2.0:1789081679.554707:0:6584:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cc2efcf1/0xb7cb3d7479d5ffd9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081679.555090:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081679.555140:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081679.555231:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796124288 00000100:00100000:1.0:1789081679.555241:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796124288 00010000:00010000:1.0:1789081679.555291:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d4df4081/0xb7cb3d7479d5fd94 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a96f expref: 12 pid: 7788 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081679.555337:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 56 00000100:00100000:1.0:1789081679.555348:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f98d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41476931-e751-413e-b98c-64d4d0edcd05+12:2351:x1875987796124288:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789081679.555369:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789081679.555376:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d4df4081/0xb7cb3d7479d5fd94 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a96f expref: 12 pid: 7788 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.555390:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d4df4081/0xb7cb3d7479d5fd94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a96f expref: 12 pid: 7788 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.555420:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4df4081/0xb7cb3d7479d5fd94 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a96f expref: 12 pid: 7788 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.555454:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789081679.555459:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789081679.555466:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cc2efcf1/0xb7cb3d7479d5ffd9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.555489:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc2efcf1/0xb7cb3d7479d5ffd9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.555561:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789081679.555629:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f98d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41476931-e751-413e-b98c-64d4d0edcd05+11:2351:x1875987796124288:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 282us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081679.555639:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 56 00010000:00010000:1.0:1789081679.555682:0:6584:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cc2efcf1/0xb7cb3d7479d5ffd9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.555692:0:6584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc2efcf1/0xb7cb3d7479d5ffd9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.555704:0:6584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc2efcf1/0xb7cb3d7479d5ffd9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.555713:0:6584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc2efcf1/0xb7cb3d7479d5ffd9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.555733:0:6584:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789081679.556568:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d16c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3305:x1875987821299328:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13971us (14431us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789081679.556580:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789081679.556603:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796124160 00000100:00100000:1.0:1789081679.556609:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796124160 00000100:00100000:1.0:1789081679.556649:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 43 00000100:00100000:1.0:1789081679.556659:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f98d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+11:2348:x1875987796124160:12345-192.168.201.17@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1789081679.556739:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789081679.556747:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc2efcf1/0xb7cb3d7479d5ffd9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.556758:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101775000 already unused, calling callback (ffffffffc1784220) 00010000:00010000:1.0:1789081679.556763:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc2efcf1/0xb7cb3d7479d5ffd9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.556773:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc2efcf1/0xb7cb3d7479d5ffd9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.556789:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc2efcf1/0xb7cb3d7479d5ffd9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.556798:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc2efcf1/0xb7cb3d7479d5ffd9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.556819:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081679.556822:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081679.556823:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789081679.556883:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e10f5a6a680/2, rc 0, transno 4294967310 00000100:00100000:1.0:1789081679.556891:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5a6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821299328:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1789081679.645069:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789081679.648331:0:7493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:0.0:1789081679.648365:0:7493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:0.0:1789081679.648378:0:7493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:3.0:1789081679.649067:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f98d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+6:2348:x1875987796124160:12345-192.168.201.17@tcp:16:lhsmtool_posix.0 Request processed in 92395us (94583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081679.649083:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 43 00000100:00100000:3.0:1789081679.654397:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081679.654553:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796124544 00000100:00100000:1.0:1789081679.654568:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796124544 00000100:00100000:1.0:1789081679.654666:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 125 00000100:00100000:1.0:1789081679.654679:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f98d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+15:10531:x1875987796124544:12345-192.168.201.17@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789081679.654762:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789081679.654801:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775200/0xb7cb3d7479d5ffbd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa02 expref: 15 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.654827:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e10d19d3600) 00010000:00010000:1.0:1789081679.654835:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789081679.654876:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5ffe0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.654892:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5ffe0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.654904:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5ffe0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789081679.655240:0:5789:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000af2e0bde reply state 000000009a553580 transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5ffe0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081679.655253:0:5789:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789081679.655393:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f98d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+16:10531:x1875987796124544:12345-192.168.201.17@tcp:36:lhsmtool_posix.0 Request processed in 716us (1012us total) trans 4294967402 rc 0/0 00000100:00100000:1.0:1789081679.655402:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 125 00010000:00010000:3.0:1789081679.659474:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5ffe0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.659501:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5ffe0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.659511:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5ffe0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.659518:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13afe00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081679.659612:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5ffe0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.659623:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5ffe0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.659707:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e10d19d3600) 00010000:00010000:3.0:1789081679.659711:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081679.659719:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5ffe0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.659726:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d5ffe0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081679.662413:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081679.662731:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796124672 00000100:00100000:1.0:1789081679.662766:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796124672 00000100:00100000:1.0:1789081679.662853:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 44 00000100:00100000:1.0:1789081679.662864:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f98d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41476931-e751-413e-b98c-64d4d0edcd05+6:2350:x1875987796124672:12345-192.168.201.17@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789081679.663233:0:6582:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789081679.663238:0:6582:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1789081679 -> 1789081678 00002000:00010000:1.0:1789081679.663240:0:6582:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789081678 00002000:00010000:1.0:1789081679.663242:0:6582:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789081679 -> 1789081678 00002000:00010000:1.0:1789081679.663245:0:6582:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789081679.663706:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f98d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41476931-e751-413e-b98c-64d4d0edcd05+7:2350:x1875987796124672:12345-192.168.201.17@tcp:2:lhsmtool_posix.0 Request processed in 839us (1305us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1789081679.663721:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 44 00000100:00100000:1.0:1789081679.670824:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081679.672270:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796124928 00000100:00100000:2.0:1789081679.672291:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796124928 00000100:00100000:2.0:1789081679.672383:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 126 00000100:00100000:2.0:1789081679.672394:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+15:10531:x1875987796124928:12345-192.168.201.17@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789081679.672501:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d5ffe7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.672557:0:9245:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5ffa1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9f4 expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.672571:0:9245:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d5ffe7 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.672622:0:9245:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5ffa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9f4 expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.672639:0:9245:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5ffa1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9f4 expref: 15 pid: 5790 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081679.672669:0:9245:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d16c6300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9245:1875987821299712:192.168.201.17@tcp:104: 00000100:00100000:2.0:1789081679.672827:0:9245:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c673a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789081679.675488:0:9245:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d16c6300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9245:1875987821299712:192.168.201.17@tcp:104: 00010000:00010000:2.0:1789081679.675572:0:9245:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d5ffe7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081679.681352:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081679.682042:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796125056 00000100:00100000:0.0:1789081679.682057:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796125056 00010000:00010000:0.0:1789081679.682117:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5ffa1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9f4 expref: 16 pid: 5790 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081679.682172:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 57 00000100:00100000:0.0:1789081679.682183:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41476931-e751-413e-b98c-64d4d0edcd05+16:2351:x1875987796125056:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789081679.682202:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789081679.682210:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5ffa1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9f4 expref: 16 pid: 5790 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.682225:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5ffa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9f4 expref: 16 pid: 5790 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.682254:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d5ffa1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9f4 expref: 16 pid: 5790 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.682274:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e10d19d3600) 00010000:00010000:0.0:1789081679.682280:0:5774:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d5ffe7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.682291:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d5ffe7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.682300:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d5ffe7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.682335:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789081679.682409:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41476931-e751-413e-b98c-64d4d0edcd05+15:2351:x1875987796125056:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 227us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081679.682437:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 57 00010000:00010000:1.0:1789081679.682554:0:9245:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d5ffe7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.682563:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d5ffe7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.682602:0:9245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d5ffe7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.682610:0:9245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d5ffe7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.682617:0:9245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d5ffe7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.682623:0:9245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101774c00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081679.682629:0:9245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d5ffe7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.682661:0:9245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d5ffe7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.682672:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e10d19d3600) 00010000:00010000:1.0:1789081679.682675:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789081679.682680:0:9245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d5ffe7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.682687:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d5ffe7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081679.682739:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+14:10531:x1875987796124928:12345-192.168.201.17@tcp:55:lhsmtool_posix.0 Request processed in 10347us (11932us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789081679.682749:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 126 00000100:00100000:0.0:1789081679.690298:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081679.690402:0:7788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796125184 00000100:00100000:2.0:1789081679.690435:0:7788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796125184 00000100:00100000:2.0:1789081679.690506:0:7788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 45 00000100:00100000:2.0:1789081679.690519:0:7788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff645c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41476931-e751-413e-b98c-64d4d0edcd05+7:2350:x1875987796125184:12345-192.168.201.17@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789081679.690623:0:7788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ecc20a8e/0xb7cb3d7479d5ffee lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.690660:0:7788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cda72b71/0xb7cb3d7479d5ffcb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa10 expref: 7 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.690670:0:7788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789081679.690675:0:7788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789081679.690681:0:7788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecc20a8e/0xb7cb3d7479d5ffee lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.690728:0:7788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cda72b71/0xb7cb3d7479d5ffcb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa10 expref: 7 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.690744:0:7788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cda72b71/0xb7cb3d7479d5ffcb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa10 expref: 7 pid: 6581 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081679.690762:0:7788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d16c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7788:1875987821299840:192.168.201.17@tcp:104: 00000100:00100000:2.0:1789081679.691177:0:7788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c673a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789081679.707434:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081679.707724:0:7788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d16c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7788:1875987821299840:192.168.201.17@tcp:104: 00010000:00010000:2.0:1789081679.707766:0:7788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ecc20a8e/0xb7cb3d7479d5ffee lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081679.708079:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796125312 00000100:00100000:1.0:1789081679.708089:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796125312 00010000:00010000:1.0:1789081679.708139:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cda72b71/0xb7cb3d7479d5ffcb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa10 expref: 8 pid: 6581 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081679.708188:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 58 00000100:00100000:1.0:1789081679.708199:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f98d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41476931-e751-413e-b98c-64d4d0edcd05+8:2350:x1875987796125312:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789081679.708219:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789081679.708251:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cda72b71/0xb7cb3d7479d5ffcb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa10 expref: 8 pid: 6581 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.708267:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cda72b71/0xb7cb3d7479d5ffcb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa10 expref: 8 pid: 6581 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.708311:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cda72b71/0xb7cb3d7479d5ffcb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa10 expref: 8 pid: 6581 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.708330:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789081679.708336:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789081679.708342:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ecc20a8e/0xb7cb3d7479d5ffee lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.708353:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecc20a8e/0xb7cb3d7479d5ffee lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.708387:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789081679.708515:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f98d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41476931-e751-413e-b98c-64d4d0edcd05+7:2350:x1875987796125312:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 317us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081679.708593:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 58 00010000:00010000:2.0:1789081679.708693:0:7788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ecc20a8e/0xb7cb3d7479d5ffee lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.708702:0:7788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ecc20a8e/0xb7cb3d7479d5ffee lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.708736:0:7788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ecc20a8e/0xb7cb3d7479d5ffee lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.708745:0:7788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ecc20a8e/0xb7cb3d7479d5ffee lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.708754:0:7788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ecc20a8e/0xb7cb3d7479d5ffee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.708763:0:7788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101775e00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:2.0:1789081679.708769:0:7788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecc20a8e/0xb7cb3d7479d5ffee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.708790:0:7788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecc20a8e/0xb7cb3d7479d5ffee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.708804:0:7788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ecc20a8e/0xb7cb3d7479d5ffee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.708827:0:7788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecc20a8e/0xb7cb3d7479d5ffee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081679.708888:0:7788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff645c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41476931-e751-413e-b98c-64d4d0edcd05+6:2350:x1875987796125184:12345-192.168.201.17@tcp:1:lhsmtool_posix.0 Request processed in 18371us (18606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081679.708898:0:7788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 45 00000100:00100000:1.0:1789081679.722278:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081679.729704:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796125568 00000100:00100000:3.0:1789081679.729726:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796125568 00000100:00100000:3.0:1789081679.729824:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 127 00000100:00100000:3.0:1789081679.729838:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5dda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+14:10531:x1875987796125568:12345-192.168.201.17@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789081679.729978:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5fff5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.730002:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5fff5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.730016:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5fff5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.730351:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fffc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.730364:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5ffaf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9fb expref: 15 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.730373:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fffc lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.730420:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5ffaf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9fb expref: 15 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.730436:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5ffaf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9fb expref: 15 pid: 5789 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081679.730452:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f98d5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5791:1875987821299968:192.168.201.17@tcp:104: 00000100:00100000:3.0:1789081679.730628:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c923f900 going to sleep for 11 seconds 00000100:00100000:0.0:1789081679.740597:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081679.740635:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796125696 00000100:00100000:0.0:1789081679.740663:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796125696 00010000:00010000:0.0:1789081679.740722:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5ffaf lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9fb expref: 16 pid: 5789 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081679.740778:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 59 00000100:00100000:0.0:1789081679.740789:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff780380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41476931-e751-413e-b98c-64d4d0edcd05+16:2350:x1875987796125696:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789081679.740809:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789081679.740818:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5ffaf lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9fb expref: 16 pid: 5789 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.740834:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5ffaf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9fb expref: 16 pid: 5789 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.740864:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e10d19d3600) 00010000:00010000:0.0:1789081679.740870:0:5774:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fffc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.740882:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fffc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.740892:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fffc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.740917:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789081679.741011:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff780380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41476931-e751-413e-b98c-64d4d0edcd05+16:2350:x1875987796125696:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 223us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081679.741019:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 59 00010000:00010000:3.0:1789081679.741851:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d5ffaf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9fb expref: 15 pid: 5789 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081679.741875:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f98d5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5791:1875987821299968:192.168.201.17@tcp:104: 00010000:00010000:3.0:1789081679.741915:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fffc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.741926:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fffc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.741932:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fffc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789081679.742201:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1789081679.742381:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:3.0:1789081679.742434:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1789081679.743381:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f98d5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5791:1875987821300096:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789081679.743480:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081679.743576:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d0d59240 going to sleep for 11 seconds 00000100:00100000:2.0:1789081679.748409:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821300096 00000100:00100000:2.0:1789081679.748434:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821300096 00000100:00100000:2.0:1789081679.748545:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789081679.748559:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f98d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5791:x1875987821300096:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789081679.749186:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f98d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5791:x1875987821300096:12345-0@lo:1000:mdt00_002.0 Request processed in 626us (5702us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081679.749198:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789081679.750950:0:5791:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1789081679.750965:0:5791:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:3.0:1789081679.751001:0:5791:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e10f5a69180, transno 4294967309 00000004:00080000:3.0:1789081679.751079:0:5791:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e10f5a6a680, transno 4294967310 00000100:00100000:3.0:1789081679.751603:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f98d5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5791:1875987821300096:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1789081679.758388:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1789081679.758498:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5a69180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5791:1875987821300224:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789081679.758649:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081679.758696:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10f5dfa240 going to sleep for 11 seconds 00000100:00100000:1.0:1789081679.763347:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821300224 00000100:00100000:1.0:1789081679.763371:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821300224 00000100:00100000:1.0:1789081679.763455:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789081679.763467:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5a6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5791:x1875987821300224:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789081679.763926:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5a6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5791:x1875987821300224:12345-0@lo:1000:mdt00_002.0 Request processed in 460us (5276us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1789081679.763937:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789081679.764193:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5a69180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5791:1875987821300224:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1789081679.764251:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fffc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.764266:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fffc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.764275:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fffc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.764281:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998000 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081679.764287:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fffc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.764296:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fffc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.764316:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e10d19d3600) 00010000:00010000:0.0:1789081679.764319:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789081679.764325:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fffc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.764331:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d5fffc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.764397:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d5ff3f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.764403:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d5ff3f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.764409:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d5ff3f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.764414:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998200 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081679.764417:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d5ff3f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.764423:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d5ff3f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.764432:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e10d19d3700) 00010000:00010000:0.0:1789081679.764434:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789081679.764443:0:5791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5ff46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9df expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.764456:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5ff46 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9df expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.764465:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5ff46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9df expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.764515:0:5791:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5ff46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9df expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081679.764564:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d11fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5791:1875987821300352:192.168.201.17@tcp:105: 00000100:00100000:0.0:1789081679.764949:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10f5dfa240 going to sleep for 11 seconds 00000100:00100000:1.0:1789081679.773256:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d11fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5791:1875987821300352:192.168.201.17@tcp:105: 00000100:00100000:3.0:1789081679.773265:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00010000:00010000:1.0:1789081679.773301:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d5ff3f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.773325:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d5ff3f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.773370:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afa00/0xb7cb3d7479d60003 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.773387:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afa00/0xb7cb3d7479d60003 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.773399:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afa00/0xb7cb3d7479d60003 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.773411:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afa00/0xb7cb3d7479d60003 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.773418:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afa00/0xb7cb3d7479d60003 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.773424:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afa00/0xb7cb3d7479d60003 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.773431:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13afa00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081679.773435:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afa00/0xb7cb3d7479d60003 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.773443:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afa00/0xb7cb3d7479d60003 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.773454:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e10d19d3700) 00010000:00010000:1.0:1789081679.773457:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789081679.773461:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afa00/0xb7cb3d7479d60003 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.773471:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afa00/0xb7cb3d7479d60003 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.773480:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5fff5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.773486:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5fff5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.773493:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5fff5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.773498:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999e00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081679.773501:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5fff5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.773507:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5fff5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.773513:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e10d19d3700) 00010000:00010000:1.0:1789081679.773515:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789081679.773518:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5fff5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.773569:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d5fff5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081679.773840:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5dda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+18:10531:x1875987796125568:12345-192.168.201.17@tcp:57:lhsmtool_posix.0 Request processed in 44004us (51573us total) trans 4294967407 rc 0/0 00000100:00100000:1.0:1789081679.773851:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 127 00000020:00080000:1.0:1789081679.773864:0:5791:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789081679.774342:0:11539:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789081679.774348:0:11539:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1789081679.774698:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796125824 00000100:00100000:2.0:1789081679.774710:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796125824 00000100:00100000:2.0:1789081679.774788:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 31 00000100:00100000:2.0:1789081679.774799:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f98d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+18:10530:x1875987796125824:12345-192.168.201.17@tcp:49:lfs.0 00000100:00100000:2.0:1789081679.774929:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f98d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+18:10530:x1875987796125824:12345-192.168.201.17@tcp:49:lfs.0 Request processed in 131us (1669us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081679.774938:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 31 00000040:00080000:3.0:1789081679.775571:0:11539:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1789081679.775583:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789081679.780204:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081679.780268:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796126080 00000100:00100000:0.0:1789081679.780282:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796126080 00000100:00100000:3.0:1789081679.780323:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081679.781720:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796126336 00000100:00100000:2.0:1789081679.781737:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796126336 00000100:00100000:2.0:1789081679.782135:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 32 00000100:00100000:2.0:1789081679.782148:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b64450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+19:10531:x1875987796126336:12345-192.168.201.17@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789081679.783485:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 128 00000100:00100000:0.0:1789081679.783506:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f98d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+20:10530:x1875987796126080:12345-192.168.201.17@tcp:58:lfs.0 00000040:00080000:0.0:1789081679.784290:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1789081679.784426:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f98d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+20:10530:x1875987796126080:12345-192.168.201.17@tcp:58:lfs.0 Request processed in 926us (4231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081679.784437:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 128 00000004:00080000:2.0:1789081679.786423:0:5792:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789081679.786743:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00010000:00010000:2.0:1789081679.786866:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775e00/0xb7cb3d7479d6000a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.786889:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775e00/0xb7cb3d7479d6000a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.786905:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775e00/0xb7cb3d7479d6000a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.786916:0:5792:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775e00/0xb7cb3d7479d6000a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.786923:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775e00/0xb7cb3d7479d6000a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.786929:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775e00/0xb7cb3d7479d6000a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081679.786957:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789081679.787006:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789081679.787017:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775e00/0xb7cb3d7479d6000a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.787026:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101775e00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:0.0:1789081679.787031:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775e00/0xb7cb3d7479d6000a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.787040:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775e00/0xb7cb3d7479d6000a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.787058:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e10c9a92000) 00010000:00010000:0.0:1789081679.787061:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789081679.787065:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775e00/0xb7cb3d7479d6000a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.787071:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775e00/0xb7cb3d7479d6000a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081679.787103:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081679.787106:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081679.787108:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789081679.787120:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b64450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+20:10531:x1875987796126336:12345-192.168.201.17@tcp:35:lhsmtool_posix.0 Request processed in 4967us (6790us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1789081679.787132:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 32 00000020:00080000:2.0:1789081679.787139:0:5792:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:3.0:1789081679.822393:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1789081679.822446:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:3.0:1789081679.827856:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081679.828022:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796126464 00000100:00100000:1.0:1789081679.828037:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796126464 00000100:00100000:1.0:1789081679.828176:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 129 00000100:00100000:1.0:1789081679.828189:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f98d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+20:10533:x1875987796126464:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:1.0:1789081679.828462:0:9245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081679.828494:0:9245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afa00/0xb7cb3d7479d60011 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2aa17 expref: -99 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.828831:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d60018 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.828850:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d60018 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.828865:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d60018 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.828884:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d6001f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.828891:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d6001f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.828898:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d6001f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.829305:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d60026 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.829319:0:9245:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d5ff31 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9d8 expref: 21 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.829328:0:9245:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d60026 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.829370:0:9245:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d5ff31 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9d8 expref: 21 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081679.829388:0:9245:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d5ff31 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9d8 expref: 21 pid: 5791 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081679.829415:0:9245:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f98d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9245:1875987821300480:192.168.201.17@tcp:104: 00000100:00100000:3.0:1789081679.829582:0:9245:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c8810cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789081679.833872:0:9245:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f98d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9245:1875987821300480:192.168.201.17@tcp:104: 00010000:00010000:3.0:1789081679.833914:0:9245:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d60026 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081679.835842:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081679.837126:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796126720 00000100:00100000:0.0:1789081679.837145:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796126720 00000100:00100000:0.0:1789081679.837329:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 33 00000100:00100000:0.0:1789081679.837342:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f98d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+22:5566:x1875987796126720:12345-192.168.201.17@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789081679.837707:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f98d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+23:5566:x1875987796126720:12345-192.168.201.17@tcp:35:ldlm_bl.0 Request processed in 368us (1877us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1789081679.837717:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 33 00000100:00100000:3.0:1789081679.840337:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081679.840573:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796126848 00000100:00100000:1.0:1789081679.840596:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796126848 00010000:00010000:1.0:1789081679.840650:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d5ff31 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9d8 expref: 23 pid: 5791 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081679.840703:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 60 00000100:00100000:1.0:1789081679.840714:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c938ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41476931-e751-413e-b98c-64d4d0edcd05+23:2351:x1875987796126848:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789081679.840736:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789081679.840745:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d5ff31 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9d8 expref: 23 pid: 5791 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.840761:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d5ff31 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9d8 expref: 23 pid: 5791 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.840802:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d5ff31 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9d8 expref: 23 pid: 5791 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.840824:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e10d19d3700) 00010000:00010000:1.0:1789081679.840831:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d60026 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.840860:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d60026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.840870:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d60026 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.840910:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789081679.840990:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c938ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41476931-e751-413e-b98c-64d4d0edcd05+22:2351:x1875987796126848:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 278us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081679.840999:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 60 00010000:00010000:1.0:1789081679.841177:0:9245:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d60026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.841187:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d60026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789081679.841259:0:9245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789081679.841265:0:9245:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789081679.841290:0:9245:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d60026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.841305:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d60026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.841316:0:9245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d60018 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.841323:0:9245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d60018 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.841329:0:9245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d60018 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.841342:0:9245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999000 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081679.841347:0:9245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d60018 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.841355:0:9245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d60018 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.841365:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e10d19d3a00) 00010000:00010000:1.0:1789081679.841368:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789081679.841372:0:9245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d60018 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.841378:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d60018 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.841389:0:9245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d6001f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.841395:0:9245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d6001f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.841401:0:9245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d6001f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.841406:0:9245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999400 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081679.841408:0:9245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d6001f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.841414:0:9245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d6001f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.841438:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e10d046f000) 00010000:00010000:1.0:1789081679.841441:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789081679.841444:0:9245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d6001f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.841451:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d6001f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.841497:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afa00/0xb7cb3d7479d60011 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa17 expref: 22 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.841516:0:9245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d60026 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa17 expref: 21 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081679.841573:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e10d19d3700) 00010000:00010000:1.0:1789081679.841577:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789081679.841580:0:9245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101998600, rc 0) 00000100:00100000:1.0:1789081679.841620:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f98d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+21:10533:x1875987796126464:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 13434us (13781us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081679.841629:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 129 00010000:00010000:1.0:1789081680.670434:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789081680.733053:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789081680.733088:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d11fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821300608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789081680.733187:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081680.733281:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821300608 00000100:00100000:0.0:1789081680.733291:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821300608 00000100:00100000:0.0:1789081680.733369:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789081680.733381:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2defb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821300608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789081680.733426:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789081680.733478:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2defb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821300608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081680.733487:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1789081680.733510:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789081680.733567:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1789081680.733649:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:0.0:1789081680.733676:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e10d1b33100, transno 4294967301 00000004:00080000:0.0:1789081680.733688:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1789081680.733713:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e10ff645f80, transno 4294967304 00000100:00100000:0.0:1789081680.733728:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d11fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821300608:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1789081680.761691:0:11910:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789081680.761704:0:11910:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789081680.761831:0:11910:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789081680.761839:0:11910:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1789081680.805018:0:11539:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789081680.805029:0:11539:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789081680.805074:0:11539:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789081680.805082:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789081680.805719:0:11539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f98d5180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11539:1875987821300736:192.168.201.17@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789081680.806552:0:11539:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c8810840 going to sleep for 11 seconds 00000100:00100000:3.0:1789081680.813966:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081680.814164:0:11539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f98d5180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11539:1875987821300736:192.168.201.17@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789081680.814372:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796126976 00000100:00100000:3.0:1789081680.814381:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796126976 00000100:00100000:3.0:1789081680.814456:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 130 00000100:00100000:3.0:1789081680.814467:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f98d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+21:10545:x1875987796126976:12345-192.168.201.17@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789081680.814518:0:5791:0:(mdt_handler.c:8081:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789081680.818257:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f98d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+21:10545:x1875987796126976:12345-192.168.201.17@tcp:53:lhsmtool_posix.0 Request processed in 3774us (4298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081680.818276:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 130 00000100:00100000:1.0:1789081680.823264:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081680.823354:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796127232 00000100:00100000:3.0:1789081680.823367:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796127232 00000100:00100000:3.0:1789081680.823449:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 131 00000100:00100000:3.0:1789081680.823462:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+21:10545:x1875987796127232:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789081680.823494:0:7252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081680.823549:0:7252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d6002d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2aa1e expref: -99 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081680.823697:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d60034 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081680.823716:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d60034 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081680.823730:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d60034 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789081680.823743:0:7252:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789081680.823940:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999400/0xb7cb3d7479d6002d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa1e expref: 24 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081680.823973:0:7252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d60034 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa1e expref: 23 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081680.823983:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e10d19d3700) 00010000:00010000:3.0:1789081680.823987:0:7252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789081680.823991:0:7252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101999000, rc 0) 00000100:00100000:3.0:1789081680.824082:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+23:10545:x1875987796127232:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 622us (834us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1789081680.824113:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 131 00000100:00100000:1.0:1789081680.830880:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081680.830983:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796127488 00000100:00100000:3.0:1789081680.830998:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796127488 00000100:00100000:3.0:1789081680.831085:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 132 00000100:00100000:3.0:1789081680.831097:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5dd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+23:10545:x1875987796127488:12345-192.168.201.17@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789081680.831214:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60042 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081680.831236:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60042 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081680.831250:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60042 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081680.831563:0:9245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60042 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081680.831581:0:9245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60042 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081680.831589:0:9245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60042 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081680.831596:0:9245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999e00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081680.831603:0:9245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60042 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081680.831612:0:9245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60042 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081680.831653:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e10d19d3700) 00010000:00010000:3.0:1789081680.831656:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789081680.831663:0:9245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60042 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081680.831671:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60042 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081680.831886:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5dd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+24:10545:x1875987796127488:12345-192.168.201.17@tcp:57:lhsmtool_posix.0 Request processed in 788us (1022us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1789081680.831896:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 132 00000040:00080000:2.0:1789081680.832632:0:11539:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789081680.832638:0:11539:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789081680.833140:0:11539:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789081680.833152:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789081680.841464:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081680.844725:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796127616 00000100:00100000:0.0:1789081680.844745:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796127616 00000100:00100000:0.0:1789081680.844856:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 9 00000100:00100000:0.0:1789081680.844868:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f98d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41476931-e751-413e-b98c-64d4d0edcd05+24:2349:x1875987796127616:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789081680.844889:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789081680.844924:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d60034 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa1e expref: 24 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081680.844947:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e10d19d3700) 00010000:00010000:0.0:1789081680.844964:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789081680.845044:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f98d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41476931-e751-413e-b98c-64d4d0edcd05+23:2349:x1875987796127616:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 178us (3594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081680.845053:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 9 00000100:00100000:3.0:1789081680.859791:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081680.859998:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796127872 00000100:00100000:2.0:1789081680.860026:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796127872 00000100:00100000:2.0:1789081680.860238:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 34 00000100:00100000:2.0:1789081680.860252:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f98d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+23:10545:x1875987796127872:12345-192.168.201.17@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789081680.860613:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f98d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+24:10545:x1875987796127872:12345-192.168.201.17@tcp:35:lhsmtool_posix.0 Request processed in 363us (835us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1789081680.860622:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 34 00000100:00100000:3.0:1789081681.244931:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789081681.244970:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f98d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821300864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789081681.245054:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081681.245139:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821300864 00000100:00100000:3.0:1789081681.245147:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821300864 00000100:00100000:3.0:1789081681.245205:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789081681.245215:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f98d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875987821300864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789081681.245255:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789081681.245301:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f98d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875987821300864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081681.245308:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1789081681.245329:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789081681.245375:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f98d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821300864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789081681.255562:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789081681.255618:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5dda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821301376:0@lo:400:kworker.0 00000100:00100000:0.0:1789081681.255697:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081681.255754:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5ddb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875987821301120:0@lo:400:kworker.0 00000100:00100000:3.0:1789081681.255818:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5dd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875987821301504:0@lo:400:kworker.0 00000100:00100000:2.0:1789081681.255847:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081681.255891:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081681.255931:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789081681.255955:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875987821301248:0@lo:400:kworker.0 00000100:00100000:3.0:1789081681.255986:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821301120 00000100:00100000:2.0:1789081681.255995:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081681.255998:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821301120 00000100:00100000:0.0:1789081681.256110:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821300992:0@lo:400:kworker.0 00000100:00100000:0.0:1789081681.256147:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081681.256289:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821301504 00000100:00100000:3.0:1789081681.256293:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821301504 00000100:00100000:2.0:1789081681.256326:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821301248 00000100:00100000:2.0:1789081681.256334:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821301248 00000100:00100000:3.0:1789081681.256348:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789081681.256361:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d16c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875987821301120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789081681.256387:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789081681.256401:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f98d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875987821301504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081681.256445:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d16c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875987821301120:12345-0@lo:400:kworker.0 Request processed in 85us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081681.256457:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789081681.256483:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f98d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875987821301504:12345-0@lo:400:kworker.0 Request processed in 82us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081681.256491:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789081681.256501:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789081681.256509:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d16c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875987821301248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789081681.256587:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821300992 00000100:00100000:2.0:1789081681.256594:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821300992 00000100:00100000:3.0:1789081681.256598:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d16c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875987821301248:12345-0@lo:400:kworker.0 Request processed in 95us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081681.256608:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789081681.256644:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1789081681.256657:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3305:x1875987821300992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081681.256685:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5dd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875987821301504:0@lo:400:kworker.0 00000100:00100000:2.0:1789081681.256718:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3305:x1875987821300992:12345-0@lo:400:kworker.0 Request processed in 63us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081681.256728:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1789081681.256755:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875987821301248:0@lo:400:kworker.0 00000100:00100000:3.0:1789081681.256768:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5ddb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875987821301120:0@lo:400:kworker.0 00000100:00100000:3.0:1789081681.256808:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821300992:0@lo:400:kworker.0 00000100:00080000:0.0:1789081681.262092:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789081681.262607:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821301376 00000100:00100000:1.0:1789081681.262619:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821301376 00000100:00100000:1.0:1789081681.262722:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789081681.262733:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821301376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081681.262848:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821301376:12345-0@lo:400:kworker.0 Request processed in 116us (7150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081681.262856:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789081681.262930:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5dda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821301376:0@lo:400:kworker.0 00010000:00010000:0.0:1789081681.693203:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789081681.883361:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081681.883417:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081681.883451:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081681.883484:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081681.883512:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081681.883660:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796128256 00000100:00100000:3.0:1789081681.883675:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796128256 00000100:00100000:3.0:1789081681.883770:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796128384 00000100:00100000:3.0:1789081681.883773:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796128384 00000100:00100000:3.0:1789081681.883804:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 47 00000100:00100000:3.0:1789081681.883815:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+5:2348:x1875987796128256:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:1.0:1789081681.884125:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796128000 00000100:00100000:1.0:1789081681.884131:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796128000 00000100:00100000:1.0:1789081681.884170:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 292 00000100:00100000:1.0:1789081681.884177:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2348:x1875987796128000:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:2.0:1789081681.884268:0:7788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 48 00000100:00100000:2.0:1789081681.884287:0:7788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41476931-e751-413e-b98c-64d4d0edcd05+6:2348:x1875987796128384:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081681.889194:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+5:2348:x1875987796128256:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 5343us (5738us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081681.889215:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 47 00000100:00100000:3.0:1789081681.889479:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796128512 00000100:00100000:3.0:1789081681.889492:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796128512 00000100:00100000:3.0:1789081681.889778:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796128128 00000100:00100000:3.0:1789081681.889783:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796128128 00000100:00100000:3.0:1789081681.889812:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 147 00000100:00100000:3.0:1789081681.889820:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d11fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03f7db20-3934-4266-b84f-346a4ea22636+5:2348:x1875987796128512:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081681.889919:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d11fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03f7db20-3934-4266-b84f-346a4ea22636+5:2348:x1875987796128512:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 100us (6467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081681.889927:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 147 00000100:00100000:3.0:1789081681.889954:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 148 00000100:00100000:3.0:1789081681.889961:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+24:2348:x1875987796128128:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081681.890000:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+24:2348:x1875987796128128:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 39us (6515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081681.890006:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 148 00000100:00080000:3.0:1789081681.890054:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789081681.890061:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789081681.890064:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789081681.890923:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2348:x1875987796128000:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 6739us (7569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081681.890948:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 292 00000100:00100000:2.0:1789081681.893767:0:7788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41476931-e751-413e-b98c-64d4d0edcd05+6:2348:x1875987796128384:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 9465us (10235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081681.893789:0:7788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 48 00010000:00010000:1.0:1789081682.720318:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789081682.875006:0:11961:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789081682.875019:0:11961:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789081682.875071:0:11961:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789081682.875078:0:11961:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789081683.071479:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081683.071680:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796128768 00000100:00100000:1.0:1789081683.071696:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796128768 00000100:00100000:1.0:1789081683.071795:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 133 00000100:00100000:1.0:1789081683.071809:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f98d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+24:10566:x1875987796128768:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:1.0:1789081683.071838:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081683.071870:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d60049 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2aa25 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081683.072024:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afa00/0xb7cb3d7479d60050 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081683.072044:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afa00/0xb7cb3d7479d60050 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081683.072058:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afa00/0xb7cb3d7479d60050 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789081683.072082:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789081683.072250:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d60049 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa25 expref: 27 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081683.072274:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afa00/0xb7cb3d7479d60050 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa25 expref: 26 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081683.072284:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e10d19d3700) 00010000:00010000:1.0:1789081683.072287:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789081683.072291:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13afa00, rc 0) 00000100:00100000:1.0:1789081683.072371:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f98d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+26:10566:x1875987796128768:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 564us (909us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1789081683.072379:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 133 00000100:00080000:3.0:1789081683.072943:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789081683.083982:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081683.084034:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796128896 00000100:00100000:3.0:1789081683.084047:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796128896 00000100:00100000:3.0:1789081683.084342:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 134 00000100:00100000:3.0:1789081683.084355:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f98d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+26:10566:x1875987796128896:12345-192.168.201.17@tcp:54:lfs.0 00010000:00010000:3.0:1789081683.084475:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d6005e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081683.084496:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d6005e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081683.084511:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d6005e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081683.084583:0:9245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d6005e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081683.084592:0:9245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d6005e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081683.084600:0:9245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d6005e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081683.084607:0:9245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999e00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081683.084612:0:9245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d6005e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081683.084620:0:9245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d6005e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081683.084633:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e10d19d3700) 00010000:00010000:3.0:1789081683.084636:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789081683.084651:0:9245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d6005e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081683.084658:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d6005e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081683.084869:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f98d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+26:10566:x1875987796128896:12345-192.168.201.17@tcp:54:lfs.0 Request processed in 516us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081683.084877:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 134 00000100:00100000:1.0:1789081683.157818:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081683.157938:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796129024 00000100:00100000:3.0:1789081683.157953:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796129024 00000100:00100000:3.0:1789081683.158113:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 46 00000100:00100000:3.0:1789081683.158127:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+6:2349:x1875987796129024:12345-192.168.201.17@tcp:101:cat.0 00010000:00010000:3.0:1789081683.158153:0:6584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081683.158182:0:6584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be9c5c2e/0xb7cb3d7479d60065 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2aa2c expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789081683.158216:0:6584:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa3384e, atime: 0x6aa3384e, ctime: 0x6aa3384e, blocks: 0xb 00010000:00010000:3.0:1789081683.158260:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=350s v=(0 0) 00010000:00010000:3.0:1789081683.158266:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081683.158278:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be9c5c2e/0xb7cb3d7479d60065 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa2c expref: 7 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081683.158302:0:6584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000be9c5c2e/0xb7cb3d7479d60065 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa2c expref: 7 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081683.158320:0:6584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101999400, rc 0) 00000100:00100000:3.0:1789081683.158400:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+7:2349:x1875987796129024:12345-192.168.201.17@tcp:101:cat.0 Request processed in 277us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081683.158408:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 46 00000100:00080000:0.0:1789081683.159344:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789081683.163783:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081683.163982:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796129152 00000100:00100000:0.0:1789081683.163998:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796129152 00002000:00100000:0.0:1789081683.164072:0:6588:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9e10f98d6300 x1875987796129152/t0(0) o3->41476931-e751-413e-b98c-64d4d0edcd05@192.168.201.17@tcp:474/0 lens 488/0 e 0 to 0 dl 1789081694 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789081683.164084:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e10f98d6300 with x1875987796129152 ext(0->4095) 00002000:00010000:0.0:1789081683.164091:0:6588:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e10f98d6300 00000100:00100000:0.0:1789081683.164134:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 3 00000100:00100000:0.0:1789081683.164145:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f98d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41476931-e751-413e-b98c-64d4d0edcd05+7:2348:x1875987796129152:12345-192.168.201.17@tcp:3:cat.0 00000100:00100000:0.0:1789081683.165143:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f98d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41476931-e751-413e-b98c-64d4d0edcd05+7:2348:x1875987796129152:12345-192.168.201.17@tcp:3:cat.0 Request processed in 993us (1366us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789081683.165155:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 3 00002000:00100000:0.0:1789081683.165166:0:6588:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9e10f98d6300 x1875987796129152/t0(0) o3->41476931-e751-413e-b98c-64d4d0edcd05@192.168.201.17@tcp:474/0 lens 488/4536 e 0 to 0 dl 1789081694 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789081683.165175:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e10f98d6300 with x1875987796129152 ext(0->4095) 00002000:00010000:0.0:1789081683.165180:0:6588:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e10f98d6300 00010000:00010000:0.0:1789081683.740953:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081684.767628:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789081684.942622:0:7493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:2.0:1789081684.942651:0:7493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1789081684.994048:0:11869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000001:00080000:0.0:1789081684.994220:0:5811:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1789081684.994390:0:11869:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e10f5dfa3c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1789081684.994396:0:11869:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e10d1b3d000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e10f5dfa780 00000020:00080000:1.0:1789081684.994399:0:11869:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e10d1b3dd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e10f9b59000 00000020:00080000:1.0:1789081684.994424:0:11869:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1789081684.994503:0:5822:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1789081684.994790:0:5822:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:0.0:1789081685.797408:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789081685.852761:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789081685.852794:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101c33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821301632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789081685.852901:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081685.853005:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821301632 00000100:00100000:0.0:1789081685.853014:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821301632 00000100:00100000:0.0:1789081685.853091:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789081685.853102:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101c31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821301632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789081685.853150:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789081685.853204:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101c31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821301632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081685.853213:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1789081685.853238:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789081685.853286:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101c33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821301632:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1789081685.985501:0:11539:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789081685.985514:0:11539:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789081685.985594:0:11539:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789081685.985601:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789081686.373776:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875987821301888:0@lo:400:kworker.0 00000100:00100000:1.0:1789081686.373845:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5ddb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875987821302016:0@lo:400:kworker.0 00000100:00100000:0.0:1789081686.373892:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081686.373916:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821302144:0@lo:400:kworker.0 00000100:00100000:1.0:1789081686.373990:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081686.374069:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789081686.374076:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5dda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee551687-7675-4fc6-9be1-2ccb62bdd809:3303:1875987821301760:0@lo:400:kworker.0 00000100:00100000:1.0:1789081686.374110:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081686.374134:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5dd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875987821302272:0@lo:400:kworker.0 00000100:00100000:1.0:1789081686.374182:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821302144 00000100:00100000:1.0:1789081686.374192:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821302144 00000100:00100000:1.0:1789081686.374255:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789081686.374265:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f96e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821302144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081686.374291:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821302400:0@lo:400:kworker.0 00000100:00100000:1.0:1789081686.374327:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f96e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821302144:12345-0@lo:400:kworker.0 Request processed in 63us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081686.374336:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789081686.374352:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081686.380780:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821301888 00000100:00100000:3.0:1789081686.380794:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821301888 00000100:00100000:3.0:1789081686.381277:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789081686.381291:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101c33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875987821301888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081686.382055:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101c33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875987821301888:12345-0@lo:400:kworker.0 Request processed in 766us (8162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081686.382067:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789081686.382258:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821302400 00000100:00100000:1.0:1789081686.382269:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821302400 00000100:00100000:0.0:1789081686.382535:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821301760 00000100:00100000:0.0:1789081686.382542:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821301760 00000100:00100000:0.0:1789081686.382593:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1789081686.382602:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3303:x1875987821301760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081686.382659:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3303:x1875987821301760:12345-0@lo:400:kworker.0 Request processed in 58us (8548us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081686.382667:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1789081686.382770:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081686.382838:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821302144:0@lo:400:kworker.0 00000100:00100000:0.0:1789081686.382885:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5dda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee551687-7675-4fc6-9be1-2ccb62bdd809:3303:1875987821301760:0@lo:400:kworker.0 00000100:00100000:3.0:1789081686.383036:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875987821301888:0@lo:400:kworker.0 00000100:00100000:3.0:1789081686.383047:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789081686.383063:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f98d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821302528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789081686.383106:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081686.383420:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789081686.383430:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101c30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821302400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081686.383476:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101c30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821302400:12345-0@lo:400:kworker.0 Request processed in 49us (9136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081686.383483:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789081686.383513:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1789081686.383519:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1789081686.383563:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821302400:0@lo:400:kworker.0 00000100:00100000:1.0:1789081686.383584:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081686.383627:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821302272 00000100:00100000:1.0:1789081686.383633:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821302272 00000100:00100000:0.0:1789081686.385036:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821302016 00000100:00100000:0.0:1789081686.385049:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821302016 00000100:00080000:2.0:1789081686.386559:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789081686.386570:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789081686.387651:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789081686.387832:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875987821302272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081686.387983:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875987821302272:12345-0@lo:400:kworker.0 Request processed in 161us (5212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081686.387991:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789081686.388061:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5dd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875987821302272:0@lo:400:kworker.0 00000100:00100000:1.0:1789081686.388118:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821302528 00000100:00100000:1.0:1789081686.388126:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821302528 00000100:00100000:1.0:1789081686.388169:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789081686.388175:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9176450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821302528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789081686.388211:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789081686.388250:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9176450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821302528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (5144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081686.388256:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789081686.388988:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f98d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821302528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789081686.391197:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789081686.392635:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f96e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875987821302016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081686.393025:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f96e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875987821302016:12345-0@lo:400:kworker.0 Request processed in 1810us (9433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081686.393040:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789081686.393569:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5ddb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875987821302016:0@lo:400:kworker.0 00010000:00010000:0.0:1789081686.815010:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789081687.010665:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081687.010755:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796129280 00000100:00100000:1.0:1789081687.010769:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796129280 00000100:00100000:1.0:1789081687.010854:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 294 00000100:00100000:1.0:1789081687.010866:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2351:x1875987796129280:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:1.0:1789081687.010970:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2351:x1875987796129280:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 105us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081687.010978:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 294 00000100:00100000:1.0:1789081687.014364:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081687.014412:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081687.014476:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081687.014575:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081687.016589:0:7788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796129536 00000100:00100000:0.0:1789081687.016612:0:7788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796129536 00000100:00100000:0.0:1789081687.016726:0:7788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796129664 00000100:00100000:0.0:1789081687.016731:0:7788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796129664 00000100:00100000:0.0:1789081687.016765:0:7788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 51 00000100:00100000:0.0:1789081687.016780:0:7788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f96e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41476931-e751-413e-b98c-64d4d0edcd05+5:2351:x1875987796129536:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:0.0:1789081687.016901:0:7788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f96e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41476931-e751-413e-b98c-64d4d0edcd05+5:2351:x1875987796129536:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 125us (2487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081687.016911:0:7788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 51 00000100:00100000:0.0:1789081687.016930:0:7788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 52 00000100:00100000:0.0:1789081687.016937:0:7788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5e5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41476931-e751-413e-b98c-64d4d0edcd05+6:2351:x1875987796129664:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:0.0:1789081687.016967:0:7788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5e5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41476931-e751-413e-b98c-64d4d0edcd05+6:2351:x1875987796129664:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 30us (2403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081687.016973:0:7788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 52 00000100:00080000:1.0:1789081687.017784:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789081687.017792:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789081687.017882:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796129408 00000100:00100000:2.0:1789081687.017891:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796129408 00000100:00100000:2.0:1789081687.017967:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796129792 00000100:00100000:2.0:1789081687.017971:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796129792 00000100:00100000:2.0:1789081687.018002:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 152 00000100:00100000:2.0:1789081687.018012:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f96e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+13:2351:x1875987796129408:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:2.0:1789081687.018074:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f96e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+13:2351:x1875987796129408:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 64us (3726us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081687.018083:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 152 00000100:00100000:2.0:1789081687.018098:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 153 00000100:00100000:2.0:1789081687.018104:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f96e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03f7db20-3934-4266-b84f-346a4ea22636+5:2351:x1875987796129792:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:2.0:1789081687.018129:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f96e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03f7db20-3934-4266-b84f-346a4ea22636+5:2351:x1875987796129792:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 25us (3653us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081687.018161:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 153 00000100:00080000:1.0:1789081687.018804:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789081687.837893:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081688.698780:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081688.701545:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796129920 00000100:00100000:1.0:1789081688.701567:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796129920 00000100:00100000:1.0:1789081688.701688:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 135 00000100:00100000:1.0:1789081688.701701:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f98d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+13:10219:x1875987796129920:12345-192.168.201.17@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789081688.701882:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f98d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+13:10219:x1875987796129920:12345-192.168.201.17@tcp:60:lhsmtool_posix.0 Request processed in 183us (3118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081688.701891:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 135 00000100:00100000:2.0:1789081688.718029:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081688.718140:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796130176 00000100:00100000:3.0:1789081688.718155:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796130176 00000100:00100000:3.0:1789081688.718237:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 35 00000100:00100000:3.0:1789081688.718250:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d16c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+13:10219:x1875987796130176:12345-192.168.201.17@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789081688.718951:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d16c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+14:10219:x1875987796130176:12345-192.168.201.17@tcp:35:lhsmtool_posix.0 Request processed in 699us (934us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1789081688.718962:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 35 00010000:00010000:0.0:1789081688.861072:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789081689.168208:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081689.168384:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796130304 00000100:00100000:0.0:1789081689.168395:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796130304 00000100:00100000:0.0:1789081689.168472:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 136 00000100:00100000:0.0:1789081689.168483:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d16c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03f7db20-3934-4266-b84f-346a4ea22636+5:11022:x1875987796130304:12345-192.168.201.17@tcp:101:lsof.0 00010000:00010000:0.0:1789081689.168505:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081689.168558:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d6006c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2aa33 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081689.168630:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d60073 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081689.168644:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d60073 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081689.168656:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d60073 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789081689.168953:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789081689.168958:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1789081689.169198:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d60073 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081689.169232:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d6006c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa33 expref: 7 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081689.169249:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d60073 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa33 expref: 6 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081689.169258:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c9a92500) 00010000:00010000:0.0:1789081689.169261:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789081689.169273:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101982e00, rc 0) 00000100:00100000:0.0:1789081689.169388:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d16c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03f7db20-3934-4266-b84f-346a4ea22636+6:11022:x1875987796130304:12345-192.168.201.17@tcp:101:lsof.0 Request processed in 907us (1189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081689.169397:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 136 00000100:00080000:1.0:1789081689.169595:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789081689.889116:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1789081689.999394:0:5811:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:3.0:1789081689.999399:0:11870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:0.0:1789081689.999422:0:5822:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1789081689.999433:0:5822:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1789081690.916954:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789081690.973259:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789081690.973288:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101ad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821302656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789081690.973368:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081690.974497:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821302656 00000100:00100000:0.0:1789081690.974511:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821302656 00000100:00100000:0.0:1789081690.974618:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789081690.974629:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d16c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821302656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789081690.974673:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789081690.974755:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d16c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821302656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (1385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081690.974763:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789081690.974874:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101ad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821302656:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789081690.974943:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789081691.486726:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f96e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875987821302912:0@lo:400:kworker.0 00000100:00100000:1.0:1789081691.486835:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081691.486903:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f96e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821303424:0@lo:400:kworker.0 00000100:00100000:1.0:1789081691.486935:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081691.486966:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789081691.486971:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f96e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875987821303040:0@lo:400:kworker.0 00000100:00100000:1.0:1789081691.486993:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081691.487070:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821302912 00000100:00100000:1.0:1789081691.487078:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821302912 00000100:00100000:1.0:1789081691.487124:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821303040 00000100:00100000:1.0:1789081691.487128:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821303040 00000100:00100000:1.0:1789081691.487156:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789081691.487164:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f96e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875987821302912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081691.487215:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f96e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875987821302912:12345-0@lo:400:kworker.0 Request processed in 51us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081691.487239:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789081691.487260:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789081691.487285:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f96e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875987821303040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081691.487317:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f96e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875987821303040:12345-0@lo:400:kworker.0 Request processed in 51us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081691.487323:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:1.0:1789081691.487343:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789081691.487372:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f96e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875987821303040:0@lo:400:kworker.0 00000100:00100000:1.0:1789081691.487384:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f96e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875987821302912:0@lo:400:kworker.0 00000100:00100000:2.0:1789081691.488880:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f96e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821302784:0@lo:400:kworker.0 00000100:00100000:2.0:1789081691.488942:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081691.488997:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f96e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875987821303296:0@lo:400:kworker.0 00000100:00100000:2.0:1789081691.489026:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081691.489053:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789081691.489060:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f96e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821303168:0@lo:400:kworker.0 00000100:00100000:2.0:1789081691.489082:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081691.489111:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821303296 00000100:00100000:2.0:1789081691.489117:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821303296 00000100:00100000:2.0:1789081691.489164:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789081691.489172:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d16c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875987821303296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789081691.489217:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d16c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875987821303296:12345-0@lo:400:kworker.0 Request processed in 46us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081691.489225:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:2.0:1789081691.489243:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789081691.489267:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f96e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875987821303296:0@lo:400:kworker.0 00000100:00100000:3.0:1789081691.489934:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789081691.489945:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f98d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821303552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789081691.489980:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081691.490393:0:7788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821303424 00000100:00100000:0.0:1789081691.490399:0:7788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821303424 00000100:00100000:0.0:1789081691.490449:0:7788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821303168 00000100:00100000:0.0:1789081691.490452:0:7788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821303168 00000100:00100000:0.0:1789081691.490473:0:7788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789081691.490479:0:7788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f96e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821303424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081691.490522:0:7788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f96e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821303424:12345-0@lo:400:kworker.0 Request processed in 43us (3586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081691.490551:0:7788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789081691.490562:0:7788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789081691.490567:0:7788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d16c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821303168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081691.490612:0:7788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d16c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821303168:12345-0@lo:400:kworker.0 Request processed in 44us (1528us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081691.490618:0:7788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789081691.490651:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821303552 00000100:00100000:0.0:1789081691.490655:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821303552 00000100:00100000:0.0:1789081691.490676:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789081691.490681:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f98d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821303552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789081691.490707:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789081691.490736:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f98d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821303552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081691.490742:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789081691.490802:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f98d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821303552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789081691.490813:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f96e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821303424:0@lo:400:kworker.0 00000100:00080000:3.0:1789081691.491372:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789081691.491490:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f96e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821303168:0@lo:400:kworker.0 00000100:00100000:1.0:1789081691.491868:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821302784 00000100:00100000:1.0:1789081691.491875:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821302784 00000100:00100000:1.0:1789081691.491924:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1789081691.491931:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3304:x1875987821302784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081691.491993:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3304:x1875987821302784:12345-0@lo:400:kworker.0 Request processed in 63us (3051us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081691.492000:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1789081691.492112:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f96e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821302784:0@lo:400:kworker.0 00010000:00010000:0.0:1789081691.932762:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789081692.124005:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081692.124070:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081692.124116:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796130432 00000100:00100000:0.0:1789081692.124122:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081692.124154:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796130432 00000100:00100000:0.0:1789081692.124160:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081692.124195:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081692.124238:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 296 00000100:00100000:0.0:1789081692.124240:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796130688 00000100:00100000:0.0:1789081692.124254:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796130688 00000100:00100000:3.0:1789081692.124255:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2350:x1875987796130432:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:0.0:1789081692.124325:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796130816 00000100:00100000:0.0:1789081692.124331:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796130816 00000100:00100000:0.0:1789081692.124364:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 55 00000100:00100000:2.0:1789081692.124647:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796130944 00000100:00100000:2.0:1789081692.124652:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796130944 00000100:00100000:2.0:1789081692.124680:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796130560 00000100:00100000:2.0:1789081692.124683:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796130560 00000100:00100000:0.0:1789081692.127906:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101ad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41476931-e751-413e-b98c-64d4d0edcd05+5:2350:x1875987796130688:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:0.0:1789081692.128007:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101ad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41476931-e751-413e-b98c-64d4d0edcd05+5:2350:x1875987796130688:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 3635us (3938us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081692.135936:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2350:x1875987796130432:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 119us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081692.135960:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 296 00000100:00080000:3.0:1789081692.136075:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789081692.136085:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789081692.136091:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789081692.136147:0:7788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 56 00000100:00100000:2.0:1789081692.136220:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 157 00000100:00100000:2.0:1789081692.136233:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101ad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03f7db20-3934-4266-b84f-346a4ea22636+6:2350:x1875987796130944:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:2.0:1789081692.136316:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101ad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03f7db20-3934-4266-b84f-346a4ea22636+6:2350:x1875987796130944:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 86us (12193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081692.136338:0:7788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101ad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41476931-e751-413e-b98c-64d4d0edcd05+6:2350:x1875987796130816:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:1.0:1789081692.136370:0:7788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101ad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41476931-e751-413e-b98c-64d4d0edcd05+6:2350:x1875987796130816:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 208us (12175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081692.138988:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 158 00000100:00100000:3.0:1789081692.139031:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101ad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+13:2350:x1875987796130560:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081692.139642:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101ad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+13:2350:x1875987796130560:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 631us (15478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081692.139655:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 158 00000100:00100000:0.0:1789081692.146555:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 55 00000100:00100000:1.0:1789081692.148734:0:7788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 56 00000100:00100000:2.0:1789081692.148937:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 157 00010000:00010000:0.0:1789081692.957330:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789081693.152936:0:12161:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 19:08:11 (1789081691) 00010000:00010000:0.0:1789081693.993821:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789081694.459393:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081694.459605:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796131200 00000100:00100000:2.0:1789081694.459615:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796131200 00000100:00100000:2.0:1789081694.459925:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 137 00000100:00100000:2.0:1789081694.459945:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101ad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+13:11286:x1875987796131200:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789081694.459967:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081694.459989:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d6007a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2aa3a expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081694.460058:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774200/0xb7cb3d7479d60081 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081694.460072:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774200/0xb7cb3d7479d60081 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081694.460085:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774200/0xb7cb3d7479d60081 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081694.460100:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d60088 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081694.460121:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d60088 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081694.460128:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d60088 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081694.460554:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d6008f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081694.460563:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d6008f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081694.460571:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d6008f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789081694.460581:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1789081694.460792:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774200/0xb7cb3d7479d60081 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081694.460801:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774200/0xb7cb3d7479d60081 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081694.460807:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774200/0xb7cb3d7479d60081 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081694.460812:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101774200 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081694.460817:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774200/0xb7cb3d7479d60081 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081694.460825:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774200/0xb7cb3d7479d60081 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081694.460846:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e10c9a92a00) 00010000:00010000:2.0:1789081694.460849:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081694.460854:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774200/0xb7cb3d7479d60081 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081694.460859:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774200/0xb7cb3d7479d60081 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081694.460869:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d60088 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081694.460874:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d60088 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081694.460878:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d60088 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081694.460883:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101774a00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081694.460885:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d60088 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081694.460890:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d60088 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081694.460895:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e10c9a92900) 00010000:00010000:2.0:1789081694.460896:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081694.460899:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d60088 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081694.460903:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d60088 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081694.461238:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d6007a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa3a expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081694.461250:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d6008f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa3a expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081694.461257:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e10d046fc00) 00010000:00010000:2.0:1789081694.461259:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081694.461261:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101774800, rc 0) 00000100:00100000:2.0:1789081694.461334:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101ad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+15:11286:x1875987796131200:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 1399us (1949us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1789081694.461341:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 137 00000100:00080000:3.0:1789081694.469473:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789081694.473287:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081694.473330:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081694.473411:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796131328 00000100:00100000:0.0:1789081694.473421:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796131328 00000100:00100000:0.0:1789081694.473483:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 138 00000100:00100000:0.0:1789081694.473492:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f98d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+15:11286:x1875987796131328:12345-192.168.201.17@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789081694.473631:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f98d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+15:11286:x1875987796131328:12345-192.168.201.17@tcp:59:lhsmtool_posix.0 Request processed in 140us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081694.473637:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 138 00000100:00100000:1.0:1789081694.473801:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796131456 00000100:00100000:1.0:1789081694.473805:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796131456 00000100:00100000:1.0:1789081694.473844:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 10 00000100:00100000:1.0:1789081694.473864:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f98d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41476931-e751-413e-b98c-64d4d0edcd05+15:2351:x1875987796131456:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789081694.473875:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789081694.473899:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d6008f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa3a expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081694.473915:0:7481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e10d046fc00) 00010000:00010000:1.0:1789081694.473919:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789081694.473954:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f98d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41476931-e751-413e-b98c-64d4d0edcd05+14:2351:x1875987796131456:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 91us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081694.473960:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 10 00010000:00010000:0.0:1789081695.008790:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789081695.144650:0:5811:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000040:00080000:0.0:1789081695.196757:0:11539:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789081695.196766:0:11539:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789081695.202429:0:11539:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1789081695.202443:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789081696.033379:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789081696.093591:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789081696.093625:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101ad0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821303680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789081696.093729:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081696.093909:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821303680 00000100:00100000:0.0:1789081696.093920:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821303680 00000100:00100000:0.0:1789081696.094010:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789081696.094023:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d16c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821303680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789081696.094073:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789081696.094130:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d16c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821303680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081696.094139:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1789081696.094212:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789081696.094289:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101ad0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821303680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789081696.515500:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081696.515560:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796131584 00000100:00100000:1.0:1789081696.515577:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796131584 00000100:00100000:1.0:1789081696.515688:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 139 00000100:00100000:1.0:1789081696.515701:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d16c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+13:11329:x1875987796131584:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:1.0:1789081696.518801:0:9245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081696.518855:0:9245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d6009d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2aa41 expref: -99 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.518962:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d600a4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.518980:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d600a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.518996:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d600a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.519014:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d600ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.519041:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d600ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.519049:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d600ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.519416:0:9245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d600a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.519426:0:9245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d600a4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.519433:0:9245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d600a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.519440:0:9245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13aec00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081696.519445:0:9245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d600a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.519453:0:9245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d600a4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.519467:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c9a92500) 00010000:00010000:1.0:1789081696.519471:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789081696.519476:0:9245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d600a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.519484:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d600a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.519499:0:9245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d600ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.519513:0:9245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d600ab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.519520:0:9245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d600ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.519556:0:9245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13ae600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081696.519560:0:9245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d600ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.519567:0:9245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d600ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.519576:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9e10c7ecf200) 00010000:00010000:1.0:1789081696.519579:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789081696.519582:0:9245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d600ab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.519588:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d600ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.519633:0:9245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d6009d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa41 expref: 14 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.519645:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c9a92500) 00010000:00010000:1.0:1789081696.519647:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789081696.519651:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d6009d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa41 expref: 14 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.519662:0:9245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13af600, rc 0) 00000100:00100000:1.0:1789081696.519786:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d16c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+13:11329:x1875987796131584:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 4086us (4297us total) trans 0 rc 301/301 00000100:00100000:1.0:1789081696.519797:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 139 00000100:00080000:2.0:1789081696.520119:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789081696.530014:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081696.530103:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796131840 00000100:00100000:3.0:1789081696.530116:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796131840 00000100:00100000:3.0:1789081696.530202:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 140 00000100:00100000:3.0:1789081696.530215:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f96e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+13:11329:x1875987796131840:12345-192.168.201.17@tcp:36:lfs.0 00010000:00010000:3.0:1789081696.530302:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081696.530342:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774e00/0xb7cb3d7479d5fa1b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a87a expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081696.530365:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c9a92500) 00010000:00010000:3.0:1789081696.530386:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789081696.530780:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d600b2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081696.530799:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d60073 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa33 expref: 5 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081696.530810:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d600b2 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081696.530856:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d60073 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa33 expref: 5 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081696.530872:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d60073 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa33 expref: 5 pid: 5790 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081696.530890:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f98d4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5789:1875987821303808:192.168.201.17@tcp:104: 00000100:00100000:3.0:1789081696.531010:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c5067f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789081696.545246:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081696.545332:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796131968 00000100:00100000:0.0:1789081696.545343:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796131968 00010000:00010000:0.0:1789081696.545420:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d60073 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa33 expref: 6 pid: 5790 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081696.545470:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 61 00000100:00100000:0.0:1789081696.545483:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f96e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03f7db20-3934-4266-b84f-346a4ea22636+6:2350:x1875987796131968:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789081696.545505:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789081696.545513:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d60073 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa33 expref: 6 pid: 5790 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081696.545556:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d60073 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa33 expref: 6 pid: 5790 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081696.545586:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c9a92500) 00010000:00010000:0.0:1789081696.545592:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d600b2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081696.545604:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d600b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081696.545614:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d600b2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081696.545636:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789081696.545714:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f96e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03f7db20-3934-4266-b84f-346a4ea22636+6:2350:x1875987796131968:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 233us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081696.545723:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 61 00010000:00010000:3.0:1789081696.545977:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d60073 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa33 expref: 5 pid: 5790 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081696.545995:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f98d4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5789:1875987821303808:192.168.201.17@tcp:104: 00010000:00010000:3.0:1789081696.546020:0:5789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d600b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081696.546030:0:5789:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d600b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081696.546036:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d600b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081696.546081:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d600b9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081696.546092:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d600b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081696.546100:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d600b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789081696.547587:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1789081696.547606:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d600b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081696.547617:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d600b2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081696.547625:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d600b2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081696.547632:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998200 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081696.547637:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d600b2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081696.547646:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d600b2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081696.547663:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c9a92500) 00010000:00010000:3.0:1789081696.547666:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081696.547681:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d600b2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081696.547701:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d600b2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789081696.547721:0:5789:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000046eb5870 reply state 000000009da509b2 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d600b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081696.547732:0:5789:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789081696.547851:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f96e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+14:11329:x1875987796131840:12345-192.168.201.17@tcp:36:lfs.0 Request processed in 17635us (17851us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1789081696.547860:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 140 00000100:00080000:1.0:1789081696.548168:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789081696.556451:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d600b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081696.556474:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d600b9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081696.556484:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d600b9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081696.556509:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999e00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081696.556515:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d600b9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081696.556560:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d600b9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081696.556582:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9e10d046f800) 00010000:00010000:2.0:1789081696.556586:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081696.556591:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d600b9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081696.556598:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d600b9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081696.604890:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789081696.604948:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f96e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee551687-7675-4fc6-9be1-2ccb62bdd809:3303:1875987821303936:0@lo:400:kworker.0 00000100:00100000:2.0:1789081696.604977:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789081696.605069:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081696.605075:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f96e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821304448:0@lo:400:kworker.0 00000100:00100000:2.0:1789081696.605121:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081696.605152:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f96e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875987821304320:0@lo:400:kworker.0 00000100:00100000:0.0:1789081696.605156:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d16c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821304064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789081696.605190:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081696.605201:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081696.605231:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789081696.605237:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821304448 00000100:00100000:0.0:1789081696.605240:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f96e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875987821304192:0@lo:400:kworker.0 00000100:00100000:2.0:1789081696.605247:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821304448 00000100:00100000:0.0:1789081696.605271:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081696.605311:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789081696.605322:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d16c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821304448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789081696.605384:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d16c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821304448:12345-0@lo:400:kworker.0 Request processed in 63us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081696.605392:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789081696.605469:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821304320 00000100:00100000:2.0:1789081696.605499:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821304320 00000100:00100000:0.0:1789081696.605687:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821303936 00000100:00100000:0.0:1789081696.605692:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821303936 00000100:00100000:0.0:1789081696.605729:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1789081696.605737:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3303:x1875987821303936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081696.605777:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3303:x1875987821303936:12345-0@lo:400:kworker.0 Request processed in 41us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081696.605785:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1789081696.605822:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821304064 00000100:00100000:0.0:1789081696.605826:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821304064 00000100:00100000:0.0:1789081696.605859:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789081696.605866:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101ad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821304064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789081696.606763:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789081696.606833:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101ad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821304064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 966us (1631us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081696.606842:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789081696.607400:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f96e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee551687-7675-4fc6-9be1-2ccb62bdd809:3303:1875987821303936:0@lo:400:kworker.0 00000100:00100000:3.0:1789081696.609014:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d16c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821304064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789081696.611786:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f96e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821304448:0@lo:400:kworker.0 00000100:00080000:3.0:1789081696.613710:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789081696.613722:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789081696.614131:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821304192 00000100:00100000:1.0:1789081696.614146:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821304192 00000100:00100000:2.0:1789081696.614149:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789081696.614167:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d16c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875987821304320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081696.614220:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789081696.614227:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875987821304192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081696.624123:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875987821304192:12345-0@lo:400:kworker.0 Request processed in 9882us (18838us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081696.624142:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789081696.624262:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789081696.624282:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f96e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875987821304576:0@lo:400:kworker.0 00000100:00100000:1.0:1789081696.624334:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081696.624378:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821304576 00000100:00100000:1.0:1789081696.624388:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821304576 00000100:00100000:1.0:1789081696.624452:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789081696.624463:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f96e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875987821304576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081696.624560:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f96e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875987821304576:12345-0@lo:400:kworker.0 Request processed in 99us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081696.624567:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:1.0:1789081696.624584:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789081696.624623:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f96e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875987821304576:0@lo:400:kworker.0 00000100:00100000:3.0:1789081696.624758:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f96e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875987821304192:0@lo:400:kworker.0 00000100:00100000:2.0:1789081696.627178:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d16c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875987821304320:12345-0@lo:400:kworker.0 Request processed in 13004us (21972us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081696.627198:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789081696.627415:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f96e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875987821304320:0@lo:400:kworker.0 00000100:00100000:2.0:1789081696.653721:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081696.653812:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796132096 00000100:00100000:1.0:1789081696.653826:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796132096 00000100:00100000:1.0:1789081696.653931:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 141 00000100:00100000:1.0:1789081696.653943:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d16c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+13:11337:x1875987796132096:12345-192.168.201.17@tcp:101:lctl.0 00010000:00010000:1.0:1789081696.653981:0:9245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081696.654017:0:9245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d600c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2aa48 expref: -99 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.654110:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d600c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.654129:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d600c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.654144:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d600c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789081696.654227:0:9245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1789081696.654232:0:9245:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1789081696.654270:0:9245:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d600c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.654303:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d600c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa48 expref: 15 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.654326:0:9245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d600c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa48 expref: 14 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.654337:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c7ecf200) 00010000:00010000:1.0:1789081696.654341:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789081696.654346:0:9245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13ae600, rc 0) 00000100:00100000:1.0:1789081696.654435:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d16c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+14:11337:x1875987796132096:12345-192.168.201.17@tcp:101:lctl.0 Request processed in 493us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081696.654450:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 141 00000100:00100000:0.0:1789081696.771096:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081696.773688:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796132224 00000100:00100000:1.0:1789081696.773709:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796132224 00000100:00100000:1.0:1789081696.773798:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 142 00000100:00100000:1.0:1789081696.773810:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+14:11343:x1875987796132224:12345-192.168.201.17@tcp:101:bash.0 00010000:00010000:1.0:1789081696.773837:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081696.773867:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d600ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2aa4f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.773955:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d600d5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.773973:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d600d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.773987:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d600d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.774003:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d600dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.774010:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d600dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.774017:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d600dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.774158:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d600e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.774190:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d600e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.774199:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d600e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789081696.774239:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1789081696.774243:0:5789:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789081696.774271:0:5789:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d600e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.774287:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d600d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.774295:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d600d5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.774302:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d600d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.774310:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13af600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081696.774315:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d600d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.774324:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d600d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.774339:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c7ecf200) 00010000:00010000:1.0:1789081696.774342:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789081696.774347:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d600d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.774364:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d600d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.774381:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d600dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.774387:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d600dc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.774393:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d600dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.774398:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13aee00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081696.774402:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d600dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.774408:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d600dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.774416:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9e10c7ecfa00) 00010000:00010000:1.0:1789081696.774419:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789081696.774422:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d600dc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.774428:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d600dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.774462:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d600ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa4f expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.774477:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d600e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa4f expref: 15 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081696.774491:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e10c7ecf100) 00010000:00010000:1.0:1789081696.774493:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789081696.774496:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13af400, rc 0) 00000100:00100000:1.0:1789081696.774614:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+15:11343:x1875987796132224:12345-192.168.201.17@tcp:101:bash.0 Request processed in 806us (3531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081696.774622:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 142 00000100:00100000:1.0:1789081696.792941:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081696.793163:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796132480 00000100:00100000:2.0:1789081696.793176:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796132480 00000100:00100000:2.0:1789081696.793271:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 143 00000100:00100000:2.0:1789081696.793282:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f96e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+15:11343:x1875987796132480:12345-192.168.201.17@tcp:101:bash.0 00010000:00010000:2.0:1789081696.793315:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081696.793345:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d600ea lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2aa56 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081696.793549:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d600f1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081696.793568:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d600f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081696.793582:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d600f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081696.793599:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d600f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081696.793606:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d600f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081696.793633:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d600f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789081696.794378:0:5791:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1789081696.794633:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d600ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081696.794649:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d600ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081696.794660:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d600ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081696.794715:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d600f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081696.794723:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d600f1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081696.794731:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d600f1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081696.794738:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101774a00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081696.794744:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d600f1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081696.794753:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d600f1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081696.794769:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e10c7ecf100) 00010000:00010000:2.0:1789081696.794772:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081696.794787:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d600f1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081696.794794:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d600f1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789081696.794810:0:5791:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002547855e reply state 00000000ce490ce1 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d600f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081696.794821:0:5791:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789081696.794865:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d600ea lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa56 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081696.794881:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d600ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa56 expref: 17 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081696.794890:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10c9a92900) 00010000:00010000:2.0:1789081696.794893:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789081696.794895:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101774400, rc 0) 00000100:00100000:2.0:1789081696.795003:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f96e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+18:11343:x1875987796132480:12345-192.168.201.17@tcp:101:bash.0 Request processed in 1721us (2077us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1789081696.795011:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 143 00010000:00010000:3.0:1789081696.801731:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d600f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081696.801756:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d600f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081696.801766:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d600f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081696.801774:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101774000 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081696.801780:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d600f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081696.801808:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d600f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081696.801829:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e10c9a92600) 00010000:00010000:3.0:1789081696.801832:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081696.801838:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d600f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081696.801846:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d600f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081696.804748:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081696.804900:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796132608 00000100:00100000:0.0:1789081696.804915:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796132608 00000100:00100000:0.0:1789081696.805014:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 47 00000100:00100000:0.0:1789081696.805025:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f96e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41476931-e751-413e-b98c-64d4d0edcd05+5:2349:x1875987796132608:12345-192.168.201.17@tcp:101:bash.0 00010000:00010000:0.0:1789081696.805050:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081696.805079:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c994970d/0xb7cb3d7479d6010d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2aa5d expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789081696.805115:0:6581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789081696.805140:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=363s v=(0 0) 00010000:00010000:0.0:1789081696.805146:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789081696.805159:0:6581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c994970d/0xb7cb3d7479d6010d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa5d expref: 6 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081696.805182:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c994970d/0xb7cb3d7479d6010d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa5d expref: 6 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081696.805199:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101982e00, rc 0) 00000100:00100000:0.0:1789081696.805276:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f96e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41476931-e751-413e-b98c-64d4d0edcd05+6:2349:x1875987796132608:12345-192.168.201.17@tcp:101:bash.0 Request processed in 253us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081696.805284:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 47 00000100:00080000:1.0:1789081696.805433:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789081696.809662:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081696.809763:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796132736 00000100:00100000:3.0:1789081696.809777:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796132736 00000100:00100000:3.0:1789081696.809859:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 48 00000100:00100000:3.0:1789081696.809872:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d16c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41476931-e751-413e-b98c-64d4d0edcd05+6:11343:x1875987796132736:12345-192.168.201.17@tcp:101:bash.0 00010000:00010000:3.0:1789081696.809898:0:6582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081696.809923:0:6582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d60114 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2aa64 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081696.809967:0:6582:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c994970d/0xb7cb3d7479d6010d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa5d expref: 7 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081696.809978:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081696.809983:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081696.809989:0:6582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d60114 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa64 expref: 7 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081696.810048:0:6582:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c994970d/0xb7cb3d7479d6010d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa5d expref: 7 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081696.810084:0:6582:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c994970d/0xb7cb3d7479d6010d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa5d expref: 7 pid: 6581 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081696.810103:0:6582:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f98d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6582:1875987821304704:192.168.201.17@tcp:104: 00000100:00100000:3.0:1789081696.810242:0:6582:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c5067f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789081696.823917:0:6582:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f98d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6582:1875987821304704:192.168.201.17@tcp:104: 00010000:00010000:2.0:1789081696.823971:0:6582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d60114 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa64 expref: 7 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081696.823997:0:6582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101998200, rc 0) 00000100:00100000:2.0:1789081696.824100:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d16c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41476931-e751-413e-b98c-64d4d0edcd05+7:11343:x1875987796132736:12345-192.168.201.17@tcp:101:bash.0 Request processed in 14229us (14453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081696.824129:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 48 00000100:00100000:1.0:1789081696.825745:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081696.826456:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796132864 00000100:00100000:3.0:1789081696.826471:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796132864 00010000:00010000:3.0:1789081696.826565:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c994970d/0xb7cb3d7479d6010d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa5d expref: 7 pid: 6581 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081696.826624:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 62 00000100:00100000:3.0:1789081696.826636:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f96e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41476931-e751-413e-b98c-64d4d0edcd05+7:2350:x1875987796132864:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789081696.826657:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081696.826700:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c994970d/0xb7cb3d7479d6010d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa5d expref: 7 pid: 6581 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081696.826716:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c994970d/0xb7cb3d7479d6010d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa5d expref: 7 pid: 6581 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081696.826748:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c994970d/0xb7cb3d7479d6010d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa5d expref: 7 pid: 6581 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081696.826767:0:7481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081696.826788:0:7481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081696.826799:0:7481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d60114 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa64 expref: 6 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081696.826812:0:7481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d60114 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa64 expref: 6 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081696.826861:0:7481:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d60114 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa64 expref: 6 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081696.826877:0:7481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f98d4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7481:1875987821304832:192.168.201.17@tcp:105: 00000100:00100000:3.0:1789081696.826999:0:7481:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c5067000 going to sleep for 11 seconds 00000100:00100000:3.0:1789081696.841597:0:7481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f98d4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7481:1875987821304832:192.168.201.17@tcp:105: 00010000:00010000:3.0:1789081696.841635:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789081696.841722:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f96e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41476931-e751-413e-b98c-64d4d0edcd05+6:2350:x1875987796132864:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 15088us (15985us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081696.841736:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 62 00000100:00100000:0.0:1789081696.853907:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081696.854071:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796133120 00000100:00100000:2.0:1789081696.854085:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796133120 00000100:00100000:2.0:1789081696.854161:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 36 00000100:00100000:2.0:1789081696.854173:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101ad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+17:11343:x1875987796133120:12345-192.168.201.17@tcp:35:bash.0 00000100:00100000:2.0:1789081696.854700:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101ad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+18:11343:x1875987796133120:12345-192.168.201.17@tcp:35:bash.0 Request processed in 525us (805us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1789081696.854709:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 36 00000100:00100000:1.0:1789081697.007084:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081697.007200:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796133376 00000100:00100000:2.0:1789081697.007214:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796133376 00000100:00100000:2.0:1789081697.007296:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 144 00000100:00100000:2.0:1789081697.007307:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f96e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+18:11353:x1875987796133376:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:2.0:1789081697.007355:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081697.007384:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d6011b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2aa6b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789081697.007591:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1789081697.007786:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d6011b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa6b expref: 20 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.007803:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c7ecf200) 00010000:00010000:2.0:1789081697.007807:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789081697.007813:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d6011b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa6b expref: 20 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.007829:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101774800, rc 0) 00000100:00100000:2.0:1789081697.007919:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f96e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+19:11353:x1875987796133376:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 614us (857us total) trans 4294967420 rc 301/301 00000100:00100000:2.0:1789081697.007927:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 144 00000100:00100000:1.0:1789081697.010808:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081697.010934:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796133632 00000100:00100000:2.0:1789081697.010946:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796133632 00000100:00100000:2.0:1789081697.011020:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 37 00000100:00100000:2.0:1789081697.011031:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f96e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+19:11353:x1875987796133632:12345-192.168.201.17@tcp:35:lfs.0 00000100:00100000:2.0:1789081697.011394:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f96e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+20:11353:x1875987796133632:12345-192.168.201.17@tcp:35:lfs.0 Request processed in 363us (597us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1789081697.011402:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 37 00010000:00010000:0.0:1789081697.052819:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789081697.128839:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081697.129138:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796133760 00000100:00100000:1.0:1789081697.129152:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796133760 00000100:00100000:1.0:1789081697.129230:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 145 00000100:00100000:1.0:1789081697.129244:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101ad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+20:11359:x1875987796133760:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:1.0:1789081697.129294:0:7252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081697.129324:0:7252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d60129 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2aa72 expref: -99 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081697.129410:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d60130 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081697.129426:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d60130 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081697.129442:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d60130 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789081697.129584:0:7252:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1789081697.129589:0:7252:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1789081697.129619:0:7252:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d60130 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081697.129652:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d60129 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa72 expref: 22 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081697.129685:0:7252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d60130 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa72 expref: 21 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081697.129695:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e10c7ecf100) 00010000:00010000:1.0:1789081697.129698:0:7252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789081697.129702:0:7252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13aee00, rc 0) 00000100:00100000:0.0:1789081697.129842:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101ad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+21:11359:x1875987796133760:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 599us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081697.129851:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 145 00000100:00100000:1.0:1789081697.140678:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081697.140785:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796134016 00000100:00100000:2.0:1789081697.140798:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796134016 00000100:00100000:2.0:1789081697.140875:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 146 00000100:00100000:2.0:1789081697.140886:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f96e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+21:11359:x1875987796134016:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:2.0:1789081697.140915:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081697.140944:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d60137 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2aa79 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.141079:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d6013e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.141097:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d6013e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.141111:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d6013e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789081697.141124:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789081697.141330:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d60137 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa79 expref: 24 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.141352:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d6013e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa79 expref: 23 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.141361:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10c9a92900) 00010000:00010000:2.0:1789081697.141365:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789081697.141369:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101774a00, rc 0) 00000100:00100000:2.0:1789081697.141450:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f96e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+23:11359:x1875987796134016:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 566us (798us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1789081697.141459:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 146 00000100:00100000:1.0:1789081697.154311:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081697.154363:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081697.154607:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796134144 00000100:00100000:0.0:1789081697.154637:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796134144 00000100:00100000:0.0:1789081697.154735:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 11 00000100:00100000:0.0:1789081697.154748:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f96e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41476931-e751-413e-b98c-64d4d0edcd05+23:2350:x1875987796134144:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789081697.154769:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789081697.154803:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d6013e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa79 expref: 23 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081697.154828:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10c9a92900) 00010000:00010000:0.0:1789081697.154834:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789081697.154909:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f96e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41476931-e751-413e-b98c-64d4d0edcd05+22:2350:x1875987796134144:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 164us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081697.154917:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 11 00000100:00100000:3.0:1789081697.154986:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796134400 00000100:00100000:3.0:1789081697.154990:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796134400 00000100:00100000:3.0:1789081697.155030:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 147 00000100:00100000:3.0:1789081697.155037:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f96e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+22:11359:x1875987796134400:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:3.0:1789081697.155079:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081697.155099:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d6014c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2aa80 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.155210:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d60153 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.155249:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d60153 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.155262:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d60153 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789081697.155286:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789081697.155442:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d6014c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa80 expref: 25 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.155458:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d60153 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa80 expref: 24 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.155806:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10c9a92900) 00010000:00010000:3.0:1789081697.155809:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789081697.155812:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101998e00, rc 0) 00000100:00100000:3.0:1789081697.155848:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f96e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+24:11359:x1875987796134400:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 810us (1550us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1789081697.155856:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 147 00000100:00100000:0.0:1789081697.167268:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081697.167402:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796134528 00000100:00100000:2.0:1789081697.167416:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796134528 00000100:00100000:2.0:1789081697.167502:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 49 00000100:00100000:2.0:1789081697.167514:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101ad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41476931-e751-413e-b98c-64d4d0edcd05+6:2351:x1875987796134528:12345-192.168.201.17@tcp:1:lfs.0 00010000:00010000:2.0:1789081697.167625:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000784b0e4c/0xb7cb3d7479d60161 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.167651:0:6581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d60114 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa64 expref: 6 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.167672:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789081697.167678:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789081697.167683:0:6581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000784b0e4c/0xb7cb3d7479d60161 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.167727:0:6581:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d60114 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa64 expref: 6 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.167760:0:6581:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d60114 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa64 expref: 6 pid: 6582 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081697.167801:0:6581:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d16c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6581:1875987821304960:192.168.201.17@tcp:104: 00000100:00100000:2.0:1789081697.167912:0:6581:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c66820c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789081697.174230:0:6581:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d16c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6581:1875987821304960:192.168.201.17@tcp:104: 00010000:00010000:0.0:1789081697.174306:0:6581:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000784b0e4c/0xb7cb3d7479d60161 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081697.176214:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081697.176588:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796134656 00000100:00100000:3.0:1789081697.176603:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796134656 00002000:00100000:3.0:1789081697.176700:0:6587:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9e1101ad2300 x1875987796134656/t0(0) o4->41476931-e751-413e-b98c-64d4d0edcd05@192.168.201.17@tcp:488/0 lens 504/0 e 0 to 0 dl 1789081708 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789081697.176713:0:6587:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e1101ad2300 with x1875987796134656 ext(0->12) 00010000:00010000:3.0:1789081697.176724:0:6587:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d60114 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa64 expref: 7 pid: 6582 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.176768:0:6587:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d60114 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa64 expref: 7 pid: 6582 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789081697.176777:0:6587:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9e1101ad2300 00000100:00100000:3.0:1789081697.176810:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 2 00000100:00100000:3.0:1789081697.176821:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101ad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41476931-e751-413e-b98c-64d4d0edcd05+7:2350:x1875987796134656:12345-192.168.201.17@tcp:4:lfs.0 00000100:00100000:3.0:1789081697.178209:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101ad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41476931-e751-413e-b98c-64d4d0edcd05+9:2350:x1875987796134656:12345-192.168.201.17@tcp:4:lfs.0 Request processed in 1378us (1999us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789081697.178225:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 2 00002000:00100000:3.0:1789081697.178238:0:6587:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9e1101ad2300 x1875987796134656/t4294967305(0) o4->41476931-e751-413e-b98c-64d4d0edcd05@192.168.201.17@tcp:488/0 lens 504/448 e 0 to 0 dl 1789081708 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789081697.178250:0:6587:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e1101ad2300 with x1875987796134656 ext(0->12) 00010000:00010000:3.0:1789081697.178261:0:6587:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d60114 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa64 expref: 9 pid: 6582 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.179478:0:6587:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d60114 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa64 expref: 9 pid: 6582 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789081697.179498:0:6587:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9e1101ad2300 00000100:00100000:2.0:1789081697.186624:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081697.188136:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796134784 00000100:00100000:0.0:1789081697.188158:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796134784 00010000:00010000:0.0:1789081697.188395:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d60114 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa64 expref: 9 pid: 6582 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081697.188507:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 63 00000100:00100000:0.0:1789081697.188521:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d16c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41476931-e751-413e-b98c-64d4d0edcd05+9:2348:x1875987796134784:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789081697.188568:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789081697.188613:0:5774:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789081697.188617:0:5774:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789081696 00002000:00010000:0.0:1789081697.188619:0:5774:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789081697 00002000:00010000:0.0:1789081697.188621:0:5774:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789081696 00010000:00010000:0.0:1789081697.188629:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d60114 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa64 expref: 9 pid: 6582 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081697.188647:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d60114 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa64 expref: 9 pid: 6582 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081697.188690:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d60114 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa64 expref: 9 pid: 6582 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081697.188708:0:5774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789081697.188714:0:5774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789081697.188721:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000784b0e4c/0xb7cb3d7479d60161 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081697.188733:0:5774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000784b0e4c/0xb7cb3d7479d60161 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081697.188779:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789081697.188856:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d16c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41476931-e751-413e-b98c-64d4d0edcd05+8:2348:x1875987796134784:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 338us (2246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081697.188865:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 63 00010000:00010000:2.0:1789081697.189389:0:6581:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000784b0e4c/0xb7cb3d7479d60161 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.189402:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000784b0e4c/0xb7cb3d7479d60161 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.189435:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000784b0e4c/0xb7cb3d7479d60161 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.189445:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000784b0e4c/0xb7cb3d7479d60161 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.189452:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000784b0e4c/0xb7cb3d7479d60161 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.189470:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101775a00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:2.0:1789081697.189475:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000784b0e4c/0xb7cb3d7479d60161 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.189502:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000784b0e4c/0xb7cb3d7479d60161 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.189517:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000784b0e4c/0xb7cb3d7479d60161 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.189546:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000784b0e4c/0xb7cb3d7479d60161 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081697.189624:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101ad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41476931-e751-413e-b98c-64d4d0edcd05+7:2351:x1875987796134528:12345-192.168.201.17@tcp:1:lfs.0 Request processed in 22111us (22369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081697.189633:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 49 00000100:00100000:3.0:1789081697.200293:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081697.200717:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796135040 00000100:00100000:0.0:1789081697.200730:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796135040 00000100:00100000:0.0:1789081697.200804:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 38 00000100:00100000:0.0:1789081697.200833:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b64850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+24:11359:x1875987796135040:12345-192.168.201.17@tcp:35:lfs.0 00000004:00010000:0.0:1789081697.200938:0:5792:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d60153 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa80 expref: 24 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789081697.201300:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1789081697.201347:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:0.0:1789081697.202427:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:0.0:1789081697.202840:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d60168 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081697.202864:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d600ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa56 expref: 28 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081697.202875:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d60168 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081697.202923:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d600ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa56 expref: 28 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081697.202941:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d600ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa56 expref: 28 pid: 5791 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081697.202959:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101ad1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5792:1875987821305088:192.168.201.17@tcp:104: 00000100:00100000:0.0:1789081697.203174:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10f1240f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789081697.209042:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081697.209147:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101ad1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5792:1875987821305088:192.168.201.17@tcp:104: 00010000:00010000:0.0:1789081697.209186:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d60168 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081697.209918:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796135168 00000100:00100000:3.0:1789081697.209929:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796135168 00010000:00010000:3.0:1789081697.209976:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d600ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa56 expref: 29 pid: 5791 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081697.210037:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 64 00000100:00100000:3.0:1789081697.210048:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c938b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41476931-e751-413e-b98c-64d4d0edcd05+29:2350:x1875987796135168:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789081697.210068:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081697.210077:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d600ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa56 expref: 29 pid: 5791 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.210091:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d600ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa56 expref: 29 pid: 5791 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.210120:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d600ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa56 expref: 29 pid: 5791 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.210137:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10c9a92900) 00010000:00010000:3.0:1789081697.210143:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d60168 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.210155:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d60168 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.210164:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d60168 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.210294:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789081697.210362:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c938b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41476931-e751-413e-b98c-64d4d0edcd05+28:2350:x1875987796135168:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 314us (1334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081697.210371:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 64 00010000:00010000:0.0:1789081697.212041:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d60168 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081697.212061:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d60168 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789081697.212372:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:0.0:1789081697.212959:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1789081697.213113:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101ad1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5792:1875987821305216:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789081697.213207:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081697.213319:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10f1240480 going to sleep for 11 seconds 00000100:00100000:3.0:1789081697.213482:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821305216 00000100:00100000:3.0:1789081697.213760:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821305216 00000100:00100000:0.0:1789081697.213948:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789081697.213959:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5792:x1875987821305216:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789081697.214082:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5792:x1875987821305216:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 125us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081697.214091:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789081697.214182:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101ad1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5792:1875987821305216:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789081697.214839:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:2.0:1789081697.214932:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d16c7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5792:1875987821305344:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789081697.214990:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081697.215884:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c66820c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789081697.215988:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821305344 00000100:00100000:1.0:1789081697.215997:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821305344 00000100:00100000:1.0:1789081697.216053:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789081697.216063:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d16c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5792:x1875987821305344:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789081697.217225:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d16c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5792:x1875987821305344:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 1155us (2225us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789081697.217240:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789081697.217389:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d16c7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5792:1875987821305344:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789081697.217641:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1789081697.217745:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d60168 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.217759:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d60168 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.217788:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d60168 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.217795:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101983800 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081697.217800:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d60168 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.217808:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d60168 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.217829:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10c9a92900) 00010000:00010000:2.0:1789081697.217832:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789081697.217837:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d60168 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.217844:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d60168 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789081697.218099:0:5792:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789081697.218225:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1789081697.218237:0:5792:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 364100712572ns, next at 365100709937ns, rc = 0 00000001:00080000:2.0:1789081697.218244:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:2.0:1789081697.218728:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10c9a92900) 00010000:00010000:2.0:1789081697.218733:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789081697.218741:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d60153 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa80 expref: 32 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081697.218884:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b64850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+31:11359:x1875987796135040:12345-192.168.201.17@tcp:35:lfs.0 Request processed in 18052us (18612us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1789081697.218908:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 38 00000020:00080000:2.0:1789081697.218915:0:5792:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789081697.223881:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081697.223971:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796135296 00000100:00100000:0.0:1789081697.223984:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796135296 00000100:00100000:0.0:1789081697.224060:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 148 00000100:00100000:0.0:1789081697.224072:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f96e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+31:11359:x1875987796135296:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:0.0:1789081697.224104:0:7252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081697.224135:0:7252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d6016f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2aa87 expref: -99 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081697.224213:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d6016f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa87 expref: 32 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081697.224251:0:7252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d6016f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa87 expref: 32 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081697.224273:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d19d3f00) 00010000:00010000:0.0:1789081697.224276:0:7252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789081697.224280:0:7252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101983600, rc 0) 00000100:00100000:0.0:1789081697.224349:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f96e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+32:11359:x1875987796135296:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 280us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081697.224356:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 148 00000100:00100000:1.0:1789081697.228511:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081697.228790:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796135552 00000100:00100000:3.0:1789081697.228804:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796135552 00000100:00100000:3.0:1789081697.228881:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 39 00000100:00100000:3.0:1789081697.228892:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f96e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+32:11359:x1875987796135552:12345-192.168.201.17@tcp:35:lfs.0 00000100:00100000:3.0:1789081697.229219:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f96e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+33:11359:x1875987796135552:12345-192.168.201.17@tcp:35:lfs.0 Request processed in 328us (721us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1789081697.229228:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 39 00000100:00100000:1.0:1789081697.243340:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081697.243390:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081697.243432:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081697.243654:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796135936 00000100:00100000:2.0:1789081697.243677:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796135936 00000100:00100000:2.0:1789081697.243748:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 162 00000100:00100000:2.0:1789081697.243760:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f96e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03f7db20-3934-4266-b84f-346a4ea22636+5:2349:x1875987796135936:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:2.0:1789081697.243862:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f96e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03f7db20-3934-4266-b84f-346a4ea22636+5:2349:x1875987796135936:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 104us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081697.243871:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 162 00000100:00100000:3.0:1789081697.244127:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796135680 00000100:00100000:3.0:1789081697.244133:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796135680 00000100:00100000:3.0:1789081697.244179:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 298 00000100:00100000:3.0:1789081697.244187:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2349:x1875987796135680:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081697.244220:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2349:x1875987796135680:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 34us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081697.244227:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 298 00000100:00100000:0.0:1789081697.247703:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796135808 00000100:00100000:0.0:1789081697.247725:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796135808 00000100:00100000:1.0:1789081697.247891:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 58 00000100:00100000:1.0:1789081697.247904:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f96e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+6:2349:x1875987796135808:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:1.0:1789081697.248014:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f96e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+6:2349:x1875987796135808:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 113us (4580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081697.248023:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 58 00000100:00080000:3.0:1789081697.248930:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789081697.311345:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081697.311678:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796136192 00000100:00100000:0.0:1789081697.311692:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796136192 00000100:00100000:0.0:1789081697.311786:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 149 00000100:00100000:0.0:1789081697.311798:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f96e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+33:11369:x1875987796136192:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:0.0:1789081697.311850:0:9245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081697.311881:0:9245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60176 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2aa8e expref: -99 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789081697.312052:0:9245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1789081697.312204:0:9245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60176 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa8e expref: 35 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081697.312347:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c7ecf200) 00010000:00010000:0.0:1789081697.312352:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789081697.312359:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60176 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa8e expref: 35 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081697.312401:0:9245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101982600, rc 0) 00000100:00100000:0.0:1789081697.312988:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f96e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+34:11369:x1875987796136192:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 1188us (1652us total) trans 4294967434 rc 301/301 00000100:00100000:0.0:1789081697.312999:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 149 00000100:00100000:1.0:1789081697.316620:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081697.316815:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796136320 00000100:00100000:2.0:1789081697.316829:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796136320 00000100:00100000:2.0:1789081697.316910:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 150 00000100:00100000:2.0:1789081697.316922:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1100640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+34:11369:x1875987796136320:12345-192.168.201.17@tcp:34:lfs.0 00010000:00010000:2.0:1789081697.317038:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d60184 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.317061:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d60184 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.317076:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d60184 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.317094:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d6018b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.317101:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d6018b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.317108:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d6018b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.317277:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d60192 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.317286:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d60192 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.317294:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d60192 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789081697.317346:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d60192 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.317363:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d60184 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.317370:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d60184 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.317378:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d60184 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.317386:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101774600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081697.317391:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d60184 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.317399:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d60184 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.317413:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e10c7ecf100) 00010000:00010000:2.0:1789081697.317417:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081697.317422:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d60184 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.317436:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d60184 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.317453:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d6018b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.317719:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d6018b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.317726:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d6018b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.317730:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101775c00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081697.317733:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d6018b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.317739:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d6018b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.317747:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e10c9a92900) 00010000:00010000:2.0:1789081697.317750:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081697.317753:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d6018b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.317759:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d6018b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.317776:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d60192 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.317782:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d60192 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.317796:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d60192 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.317802:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101775600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081697.317805:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d60192 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.317812:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d60192 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.317819:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d19d3f00) 00010000:00010000:2.0:1789081697.317822:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081697.317825:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d60192 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.317830:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d60192 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081697.321754:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1100640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+34:11369:x1875987796136320:12345-192.168.201.17@tcp:34:lfs.0 Request processed in 4815us (5129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081697.321773:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 150 00000100:00100000:3.0:1789081697.325363:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081697.325567:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796136576 00000100:00100000:1.0:1789081697.325580:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796136576 00000100:00100000:1.0:1789081697.325653:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 40 00000100:00100000:1.0:1789081697.325674:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f98d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+34:11369:x1875987796136576:12345-192.168.201.17@tcp:35:lfs.0 00000100:00100000:1.0:1789081697.327043:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f98d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+35:11369:x1875987796136576:12345-192.168.201.17@tcp:35:lfs.0 Request processed in 1358us (1682us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1789081697.327059:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 40 00000100:00100000:1.0:1789081697.365779:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081697.366206:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796136832 00000100:00100000:3.0:1789081697.366221:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796136832 00000100:00100000:3.0:1789081697.366568:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 151 00000100:00100000:3.0:1789081697.366582:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1100640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+35:11372:x1875987796136832:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:3.0:1789081697.366617:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081697.366648:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60199 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2aa95 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.366766:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d601a0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.366809:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d601a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.366823:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d601a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.366838:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d601a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.366844:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d601a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.366851:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d601a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.367009:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d601ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.367017:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d601ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.367025:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d601ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789081697.367036:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789081697.367163:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d601a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.367172:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d601a0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.367178:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d601a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.367191:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998800 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081697.367196:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d601a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.367205:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d601a0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.367221:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e10c7ecf100) 00010000:00010000:3.0:1789081697.367224:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081697.367229:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d601a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.367236:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d601a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.367252:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d601a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.367257:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d601a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.367263:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d601a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.367268:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081697.367270:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d601a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.367694:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d601a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.367715:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e10d046f600) 00010000:00010000:3.0:1789081697.367718:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081697.367721:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d601a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.367728:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d601a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.367789:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60199 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa95 expref: 38 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.367805:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d601ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa95 expref: 37 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.367813:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d19d3f00) 00010000:00010000:3.0:1789081697.367815:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789081697.367818:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101998e00, rc 0) 00000100:00100000:3.0:1789081697.367925:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1100640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+37:11372:x1875987796136832:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 1344us (2158us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1789081697.367933:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 151 00000100:00100000:2.0:1789081697.371750:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081697.371871:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796136960 00000100:00100000:0.0:1789081697.371884:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796136960 00000100:00100000:0.0:1789081697.371987:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 152 00000100:00100000:0.0:1789081697.372000:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d16c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+37:11372:x1875987796136960:12345-192.168.201.17@tcp:54:lfs.0 00010000:00010000:0.0:1789081697.372109:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d601bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081697.372131:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d601bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081697.372146:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d601bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081697.372183:0:9245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d601bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081697.372192:0:9245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d601bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081697.372199:0:9245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d601bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081697.372205:0:9245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101982600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081697.372210:0:9245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d601bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081697.372786:0:9245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d601bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081697.372801:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d19d3f00) 00010000:00010000:0.0:1789081697.372805:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789081697.372811:0:9245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d601bc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081697.372818:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d601bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081697.372924:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d16c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+37:11372:x1875987796136960:12345-192.168.201.17@tcp:54:lfs.0 Request processed in 924us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081697.372933:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 152 00000100:00100000:3.0:1789081697.375440:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081697.375973:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796137216 00000100:00100000:1.0:1789081697.375988:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796137216 00000100:00100000:1.0:1789081697.376058:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 41 00000100:00100000:1.0:1789081697.376070:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f98d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+37:11372:x1875987796137216:12345-192.168.201.17@tcp:35:lfs.0 00000100:00100000:1.0:1789081697.376859:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f98d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+38:11372:x1875987796137216:12345-192.168.201.17@tcp:35:lfs.0 Request processed in 786us (1426us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1789081697.376870:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 41 00000100:00100000:1.0:1789081697.661317:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081697.661577:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796137472 00000100:00100000:2.0:1789081697.661592:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796137472 00000100:00100000:2.0:1789081697.661684:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 153 00000100:00100000:2.0:1789081697.661697:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1100641500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+38:11403:x1875987796137472:12345-192.168.201.17@tcp:101:cat.0 00010000:00010000:2.0:1789081697.661731:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081697.661763:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d601c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2aa9c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.661929:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d601ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.661948:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d601ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.661962:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d601ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789081697.661974:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789081697.662341:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d601c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa9c expref: 41 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.662366:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d601ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa9c expref: 40 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081697.662377:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d19d3f00) 00010000:00010000:2.0:1789081697.662381:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789081697.662385:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101774600, rc 0) 00000100:00100000:2.0:1789081697.662703:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1100641500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+40:11403:x1875987796137472:12345-192.168.201.17@tcp:101:cat.0 Request processed in 1007us (1399us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1789081697.662714:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 153 00000100:00100000:0.0:1789081697.669996:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081697.670345:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796137600 00000100:00100000:3.0:1789081697.670365:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796137600 00000100:00100000:3.0:1789081697.670469:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 12 00000100:00100000:3.0:1789081697.670483:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41476931-e751-413e-b98c-64d4d0edcd05+40:2351:x1875987796137600:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789081697.670509:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081697.670609:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d601ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa9c expref: 40 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.670668:0:7481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d19d3f00) 00010000:00010000:3.0:1789081697.670675:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789081697.670743:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41476931-e751-413e-b98c-64d4d0edcd05+39:2351:x1875987796137600:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 265us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081697.670753:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 12 00000100:00100000:0.0:1789081697.679107:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081697.679240:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796137856 00000100:00100000:1.0:1789081697.679253:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796137856 00000100:00100000:1.0:1789081697.679431:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 42 00000100:00100000:1.0:1789081697.679444:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101ad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+39:11403:x1875987796137856:12345-192.168.201.17@tcp:35:cat.0 00000100:00100000:1.0:1789081697.680282:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101ad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+40:11403:x1875987796137856:12345-192.168.201.17@tcp:35:cat.0 Request processed in 829us (1176us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1789081697.680292:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 42 00000100:00100000:1.0:1789081697.766831:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081697.766921:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796138112 00000100:00100000:3.0:1789081697.766934:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796138112 00000100:00100000:3.0:1789081697.767001:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 154 00000100:00100000:3.0:1789081697.767011:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1100642680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+40:11409:x1875987796138112:12345-192.168.201.17@tcp:101:dd.0 00010000:00010000:3.0:1789081697.767051:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081697.767054:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789081697.767083:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d60130 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa72 expref: 40 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.767104:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e10c7ecf100) 00010000:00010000:3.0:1789081697.767109:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789081697.767125:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d601d8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2aaa3 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.767233:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d601df lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.767249:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d601ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa95 expref: 40 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.767259:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d601df lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.767305:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d601ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa95 expref: 40 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.767319:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d601ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa95 expref: 40 pid: 5789 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081697.767333:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f98d4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5789:1875987821305472:192.168.201.17@tcp:104: 00000100:00100000:3.0:1789081697.767483:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c5067a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789081697.772264:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f98d4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5789:1875987821305472:192.168.201.17@tcp:104: 00010000:00010000:3.0:1789081697.772293:0:5789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d601df lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081697.772575:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081697.772930:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796138240 00000100:00100000:1.0:1789081697.772940:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796138240 00010000:00010000:1.0:1789081697.772979:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d601ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa95 expref: 41 pid: 5789 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081697.773014:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 65 00000100:00100000:1.0:1789081697.773023:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41476931-e751-413e-b98c-64d4d0edcd05+41:2350:x1875987796138240:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789081697.773039:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789081697.773046:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d601ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa95 expref: 41 pid: 5789 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081697.773058:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d601ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa95 expref: 41 pid: 5789 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081697.773081:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d601ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa95 expref: 41 pid: 5789 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081697.773097:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d19d3f00) 00010000:00010000:1.0:1789081697.773177:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d601df lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081697.773187:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d601df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081697.773195:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d601df lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081697.773233:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789081697.773357:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41476931-e751-413e-b98c-64d4d0edcd05+40:2350:x1875987796138240:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 334us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081697.773366:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 65 00010000:00010000:0.0:1789081697.773897:0:5789:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d601df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081697.773907:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d601df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789081697.773926:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789081697.774091:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d601d8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aaa3 expref: 41 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081697.774121:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d601df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aaa3 expref: 40 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081697.774144:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d19d3f00) 00010000:00010000:0.0:1789081697.774147:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789081697.774150:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101998000, rc 0) 00000100:00100000:0.0:1789081697.774182:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1100642680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+40:11409:x1875987796138112:12345-192.168.201.17@tcp:101:dd.0 Request processed in 7173us (7366us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1789081697.774191:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 154 00000100:00100000:0.0:1789081697.779924:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081697.780008:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796138496 00000100:00100000:3.0:1789081697.780016:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796138496 00000100:00100000:3.0:1789081697.780082:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 155 00000100:00100000:3.0:1789081697.780090:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101ad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+40:11409:x1875987796138496:12345-192.168.201.17@tcp:36:dd.0 00010000:00010000:3.0:1789081697.780667:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d601ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.780757:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d601ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081697.780769:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d601ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789081697.780814:0:9245:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:3.0:1789081697.780831:0:9245:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000089c484a4 reply state 00000000da5c9172 transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d601ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081697.780849:0:9245:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789081697.780964:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101ad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+43:11409:x1875987796138496:12345-192.168.201.17@tcp:36:dd.0 Request processed in 874us (1051us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1789081697.780970:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 155 00000020:00080000:3.0:1789081697.780973:0:9245:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789081697.782831:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d601ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081697.782844:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d601ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081697.782849:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d601ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081697.782852:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081697.782856:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d601ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081697.782861:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d601ed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081697.782875:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d19d3f00) 00010000:00010000:0.0:1789081697.782878:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081697.782882:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d601ed lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081697.782888:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d601ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081698.076834:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789081698.140025:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081698.140281:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796138624 00000100:00100000:2.0:1789081698.140292:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796138624 00000100:00100000:2.0:1789081698.140364:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 156 00000100:00100000:2.0:1789081698.140375:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+42:11423:x1875987796138624:12345-192.168.201.17@tcp:101:stat.0 00010000:00010000:2.0:1789081698.140401:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081698.140442:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775200/0xb7cb3d7479d601f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2aaaa expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081698.140618:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775e00/0xb7cb3d7479d601fb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081698.140633:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775e00/0xb7cb3d7479d601fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081698.140658:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775e00/0xb7cb3d7479d601fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081698.140675:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60202 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081698.140682:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60202 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081698.140688:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60202 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081698.140779:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d60209 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081698.140789:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d601df lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aaa3 expref: 43 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081698.140796:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d60209 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081698.140828:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d601df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aaa3 expref: 43 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081698.140851:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d601df lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aaa3 expref: 43 pid: 5789 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081698.140866:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d16c4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5790:1875987821305600:192.168.201.17@tcp:104: 00000100:00100000:2.0:1789081698.140968:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c6682300 going to sleep for 11 seconds 00000100:00080000:3.0:1789081698.141246:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789081698.145656:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081698.145735:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796138880 00000100:00100000:3.0:1789081698.145746:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796138880 00000100:00100000:2.0:1789081698.145761:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d16c4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5790:1875987821305600:192.168.201.17@tcp:104: 00000100:00100000:3.0:1789081698.145801:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 43 00010000:00010000:2.0:1789081698.145802:0:5790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d60209 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081698.145809:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+44:5566:x1875987796138880:12345-192.168.201.17@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789081698.146126:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+45:5566:x1875987796138880:12345-192.168.201.17@tcp:35:ldlm_bl.0 Request processed in 315us (489us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1789081698.146143:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 43 00000100:00100000:1.0:1789081698.152438:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081698.152563:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796139008 00000100:00100000:3.0:1789081698.152573:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796139008 00010000:00010000:3.0:1789081698.152614:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d601df lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aaa3 expref: 45 pid: 5789 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081698.152664:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 66 00000100:00100000:3.0:1789081698.152675:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9486680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41476931-e751-413e-b98c-64d4d0edcd05+45:2350:x1875987796139008:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789081698.152693:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081698.152700:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d601df lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aaa3 expref: 45 pid: 5789 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.152714:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d601df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aaa3 expref: 45 pid: 5789 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.152759:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d601df lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aaa3 expref: 45 pid: 5789 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.152776:0:7481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d19d3f00) 00010000:00010000:3.0:1789081698.152781:0:7481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d60209 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.152790:0:7481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d60209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.152797:0:7481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d60209 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.152833:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789081698.153688:0:5790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d60209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081698.153700:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d60209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789081698.153746:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789081698.153750:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789081698.153775:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d60209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081698.153788:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d60209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081698.153797:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775e00/0xb7cb3d7479d601fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081698.153804:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775e00/0xb7cb3d7479d601fb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081698.153823:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775e00/0xb7cb3d7479d601fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081698.153829:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101775e00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081698.153833:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775e00/0xb7cb3d7479d601fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081698.153841:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775e00/0xb7cb3d7479d601fb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081698.153864:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e10c7ecf100) 00010000:00010000:2.0:1789081698.153867:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081698.153871:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775e00/0xb7cb3d7479d601fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081698.154154:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9486680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41476931-e751-413e-b98c-64d4d0edcd05+44:2350:x1875987796139008:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 1477us (1724us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081698.154163:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 66 00010000:00010000:2.0:1789081698.154782:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775e00/0xb7cb3d7479d601fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081698.154800:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60202 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081698.154807:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60202 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081698.154813:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60202 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081698.154818:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101774c00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081698.154821:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60202 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081698.154844:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60202 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081698.154867:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e10c9a92900) 00010000:00010000:2.0:1789081698.154870:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081698.154873:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60202 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081698.155619:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60202 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081698.155682:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775200/0xb7cb3d7479d601f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aaaa expref: 44 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081698.155714:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d60209 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aaaa expref: 43 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081698.155723:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d19d3f00) 00010000:00010000:2.0:1789081698.155726:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789081698.155729:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101775c00, rc 0) 00000100:00100000:2.0:1789081698.155804:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+43:11423:x1875987796138624:12345-192.168.201.17@tcp:101:stat.0 Request processed in 15429us (15787us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081698.155814:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 156 00000100:00100000:1.0:1789081698.222804:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081698.222903:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796139264 00000100:00100000:0.0:1789081698.222914:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796139264 00000100:00100000:0.0:1789081698.222976:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 157 00000100:00100000:0.0:1789081698.222985:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+43:11429:x1875987796139264:12345-192.168.201.17@tcp:36:truncate.0 00010000:00010000:0.0:1789081698.223058:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789081698.223082:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d60209 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aaaa expref: 43 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081698.223099:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d19d3f00) 00010000:00010000:0.0:1789081698.223102:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789081698.223331:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d60210 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081698.223345:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d60210 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081698.223355:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d60210 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789081698.223405:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:0.0:1789081698.223935:0:5789:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009b77b8cf reply state 000000002f0cd7c4 transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d60210 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081698.223943:0:5789:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789081698.224034:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+45:11429:x1875987796139264:12345-192.168.201.17@tcp:36:truncate.0 Request processed in 1050us (1246us total) trans 4294967445 rc 0/0 00000100:00100000:0.0:1789081698.224044:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 157 00000020:00080000:0.0:1789081698.224056:0:5789:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789081698.225382:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d60210 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.225394:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d60210 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.225399:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d60210 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.225402:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101983000 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081698.225406:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d60210 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.225426:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d60210 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.225439:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d19d3f00) 00010000:00010000:3.0:1789081698.225441:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081698.225444:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d60210 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.225448:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d60210 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081698.525281:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081698.525380:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796139392 00000100:00100000:3.0:1789081698.525391:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796139392 00000100:00100000:3.0:1789081698.525457:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 158 00000100:00100000:3.0:1789081698.525467:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+44:11443:x1875987796139392:12345-192.168.201.17@tcp:101:stat.0 00010000:00010000:3.0:1789081698.525491:0:9245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081698.525553:0:9245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60217 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2aab1 expref: -99 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.525619:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d6021e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.525634:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d6021e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.525676:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d6021e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.525694:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60225 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.525719:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60225 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.525727:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60225 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.525827:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d6022c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.525836:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d6022c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.525844:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d6022c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789081698.525878:0:9245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1789081698.525882:0:9245:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789081698.525904:0:9245:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d6022c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.525916:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d6022c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.525924:0:9245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d6021e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.525931:0:9245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d6021e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.525937:0:9245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d6021e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.525953:0:9245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998800 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081698.525971:0:9245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d6021e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.525979:0:9245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d6021e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.525992:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e10c7ecf100) 00010000:00010000:3.0:1789081698.525995:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081698.526000:0:9245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d6021e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.526016:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d6021e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.526030:0:9245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60225 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.526036:0:9245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60225 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.526042:0:9245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60225 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.526047:0:9245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999e00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081698.526050:0:9245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60225 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.526056:0:9245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60225 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.526074:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e10d046f600) 00010000:00010000:3.0:1789081698.526077:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081698.526080:0:9245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60225 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.526085:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60225 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.526116:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60217 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aab1 expref: 46 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.526129:0:9245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d6022c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aab1 expref: 45 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.526136:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d19d3f00) 00010000:00010000:3.0:1789081698.526139:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789081698.526142:0:9245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101999000, rc 0) 00000100:00100000:3.0:1789081698.526209:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+45:11443:x1875987796139392:12345-192.168.201.17@tcp:101:stat.0 Request processed in 743us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081698.526217:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 158 00000100:00100000:0.0:1789081698.642621:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081698.642723:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796139648 00000100:00100000:2.0:1789081698.642733:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796139648 00000100:00100000:2.0:1789081698.642792:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 159 00000100:00100000:2.0:1789081698.642802:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+45:11453:x1875987796139648:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:2.0:1789081698.642838:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081698.642858:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775e00/0xb7cb3d7479d60233 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2aab8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789081698.642974:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1789081698.643092:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775e00/0xb7cb3d7479d60233 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aab8 expref: 47 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081698.643107:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c7ecf200) 00010000:00010000:2.0:1789081698.643110:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789081698.643114:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775e00/0xb7cb3d7479d60233 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aab8 expref: 47 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081698.643124:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101775e00, rc 0) 00000100:00100000:2.0:1789081698.643251:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+46:11453:x1875987796139648:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 451us (640us total) trans 4294967446 rc 301/301 00000100:00100000:2.0:1789081698.643265:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 159 00000100:00100000:2.0:1789081698.654836:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081698.659617:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796139904 00000100:00100000:3.0:1789081698.659632:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796139904 00000100:00100000:3.0:1789081698.659714:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 44 00000100:00100000:3.0:1789081698.659724:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b64c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+46:11453:x1875987796139904:12345-192.168.201.17@tcp:35:lfs.0 00000100:00100000:3.0:1789081698.659961:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b64c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+47:11453:x1875987796139904:12345-192.168.201.17@tcp:35:lfs.0 Request processed in 238us (5131us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1789081698.659968:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 44 00000100:00100000:1.0:1789081698.720746:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081698.720804:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796140160 00000100:00100000:0.0:1789081698.720814:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796140160 00000100:00100000:0.0:1789081698.720905:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 160 00000100:00100000:0.0:1789081698.720914:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+47:11459:x1875987796140160:12345-192.168.201.17@tcp:101:bash.0 00010000:00010000:0.0:1789081698.720945:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081698.720963:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d60241 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2aabf expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081698.721044:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d60248 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081698.721055:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d6022c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aab1 expref: 48 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081698.721060:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d60248 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081698.721085:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d6022c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aab1 expref: 48 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081698.721094:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d6022c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aab1 expref: 48 pid: 9245 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081698.721103:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5f0c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5789:1875987821305728:192.168.201.17@tcp:104: 00000100:00100000:0.0:1789081698.721243:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10f1240b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789081698.725042:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5f0c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5789:1875987821305728:192.168.201.17@tcp:104: 00010000:00010000:3.0:1789081698.725070:0:5789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d60248 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081698.725427:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081698.725581:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796140288 00000100:00100000:0.0:1789081698.725590:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796140288 00010000:00010000:0.0:1789081698.725647:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d6022c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aab1 expref: 49 pid: 9245 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081698.725723:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 67 00000100:00100000:0.0:1789081698.725732:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41476931-e751-413e-b98c-64d4d0edcd05+49:2351:x1875987796140288:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789081698.725746:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789081698.725753:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d6022c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aab1 expref: 49 pid: 9245 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081698.725764:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d6022c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aab1 expref: 49 pid: 9245 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081698.725785:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d6022c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aab1 expref: 49 pid: 9245 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081698.725803:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d19d3f00) 00010000:00010000:0.0:1789081698.725808:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d60248 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081698.725817:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d60248 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081698.725826:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d60248 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081698.725859:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789081698.725912:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41476931-e751-413e-b98c-64d4d0edcd05+48:2351:x1875987796140288:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 181us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081698.725918:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 67 00010000:00010000:1.0:1789081698.725977:0:5789:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d60248 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.725984:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d60248 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789081698.726002:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1789081698.726154:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d60241 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aabf expref: 49 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.726171:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d60248 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aabf expref: 48 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.726188:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d19d3f00) 00010000:00010000:1.0:1789081698.726191:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789081698.726193:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101982e00, rc 0) 00000100:00100000:1.0:1789081698.726276:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+48:11459:x1875987796140160:12345-192.168.201.17@tcp:101:bash.0 Request processed in 5362us (5541us total) trans 4294967448 rc 0/0 00000100:00100000:1.0:1789081698.726284:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 160 00000100:00100000:1.0:1789081698.729815:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081698.729891:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796140544 00000100:00100000:3.0:1789081698.729901:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796140544 00000100:00100000:3.0:1789081698.729958:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 161 00000100:00100000:3.0:1789081698.729968:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+48:11459:x1875987796140544:12345-192.168.201.17@tcp:36:bash.0 00010000:00010000:3.0:1789081698.730256:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60256 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.730273:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60256 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.730284:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60256 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789081698.730330:0:9245:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967449 00000004:00010000:3.0:1789081698.730359:0:9245:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000017e19e3d reply state 000000003cadb168 transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60256 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081698.730368:0:9245:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789081698.735119:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+51:11459:x1875987796140544:12345-192.168.201.17@tcp:36:bash.0 Request processed in 5142us (5303us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1789081698.735133:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 161 00000020:00080000:3.0:1789081698.735142:0:9245:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789081698.736800:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60256 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081698.736816:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60256 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081698.736827:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60256 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081698.736833:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998000 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081698.736837:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60256 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081698.736844:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60256 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081698.736861:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d19d3f00) 00010000:00010000:0.0:1789081698.736864:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081698.736869:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60256 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081698.736875:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60256 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081698.737409:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081698.737489:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796140672 00000100:00100000:2.0:1789081698.737500:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796140672 00000100:00100000:2.0:1789081698.737570:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 162 00000100:00100000:2.0:1789081698.737580:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+50:11459:x1875987796140672:12345-192.168.201.17@tcp:101:bash.0 00010000:00010000:2.0:1789081698.737604:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081698.737622:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d6025d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2aac6 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081698.737730:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d60264 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081698.737752:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d60248 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aabf expref: 51 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081698.737757:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d60264 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081698.737782:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d60248 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aabf expref: 51 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081698.737791:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d60248 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aabf expref: 51 pid: 5789 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081698.737802:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d16c4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5790:1875987821305856:192.168.201.17@tcp:104: 00000100:00100000:2.0:1789081698.737873:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c6682300 going to sleep for 11 seconds 00000100:00100000:2.0:1789081698.739617:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081698.739663:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796140800 00000100:00100000:0.0:1789081698.739671:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796140800 00010000:00010000:0.0:1789081698.739707:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d60248 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aabf expref: 52 pid: 5789 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081698.739743:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 68 00000100:00100000:1.0:1789081698.739746:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d16c4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5790:1875987821305856:192.168.201.17@tcp:104: 00000100:00100000:0.0:1789081698.739752:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff646680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41476931-e751-413e-b98c-64d4d0edcd05+52:2351:x1875987796140800:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789081698.739765:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789081698.739784:0:5790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d60264 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081698.739784:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d60248 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aabf expref: 52 pid: 5789 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081698.739796:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d60248 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aabf expref: 52 pid: 5789 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081698.740037:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d60248 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aabf expref: 52 pid: 5789 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081698.740052:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d19d3f00) 00010000:00010000:0.0:1789081698.740057:0:5774:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d60264 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081698.740065:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d60264 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081698.740070:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d60264 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081698.740091:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789081698.740112:0:5790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d60264 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.740119:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d60264 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081698.740142:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff646680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41476931-e751-413e-b98c-64d4d0edcd05+51:2351:x1875987796140800:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 391us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081698.740149:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 68 00000004:00200000:1.0:1789081698.740161:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789081698.740165:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789081698.740184:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d60264 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.740211:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d6025d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aac6 expref: 51 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.740697:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d60264 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aac6 expref: 50 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.740714:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d19d3f00) 00010000:00010000:1.0:1789081698.740717:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789081698.740720:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101775a00, rc 0) 00000100:00100000:1.0:1789081698.740762:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+50:11459:x1875987796140672:12345-192.168.201.17@tcp:101:bash.0 Request processed in 3183us (3356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081698.740768:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 162 00000100:00100000:2.0:1789081698.745101:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081698.745187:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796141056 00000100:00100000:3.0:1789081698.745196:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796141056 00000100:00100000:3.0:1789081698.745242:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 45 00000100:00100000:3.0:1789081698.745252:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+50:11459:x1875987796141056:12345-192.168.201.17@tcp:35:bash.0 00000100:00100000:3.0:1789081698.745485:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+51:11459:x1875987796141056:12345-192.168.201.17@tcp:35:bash.0 Request processed in 235us (392us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1789081698.745491:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 45 00000100:00100000:0.0:1789081698.788390:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081698.788551:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796141312 00000100:00100000:1.0:1789081698.788561:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796141312 00000100:00100000:1.0:1789081698.788669:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 163 00000100:00100000:1.0:1789081698.788678:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+51:11469:x1875987796141312:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:1.0:1789081698.788704:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081698.788724:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d6026b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2aacd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789081698.788825:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1789081698.788921:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d6026b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aacd expref: 53 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.788932:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c7ecf200) 00010000:00010000:1.0:1789081698.788934:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789081698.788938:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d6026b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aacd expref: 53 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.788948:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13afe00, rc 0) 00000100:00100000:1.0:1789081698.788996:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+52:11469:x1875987796141312:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 321us (613us total) trans 4294967452 rc 301/301 00000100:00100000:1.0:1789081698.789021:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 163 00000100:00100000:2.0:1789081698.790971:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081698.791016:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796141440 00000100:00100000:3.0:1789081698.791023:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796141440 00000100:00100000:3.0:1789081698.791097:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 164 00000100:00100000:3.0:1789081698.791104:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+52:11469:x1875987796141440:12345-192.168.201.17@tcp:34:lfs.0 00010000:00010000:3.0:1789081698.791159:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60279 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.791170:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60279 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.791180:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60279 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.791190:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d60280 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.791195:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d60280 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.791198:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d60280 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.791292:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60287 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.791301:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60287 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.791318:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60287 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789081698.791350:0:9245:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60287 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.791359:0:9245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60279 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.791364:0:9245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60279 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.791368:0:9245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60279 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.791372:0:9245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999e00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081698.791375:0:9245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60279 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.791379:0:9245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60279 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.791386:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e10c7ecf100) 00010000:00010000:3.0:1789081698.791388:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081698.791391:0:9245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60279 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.791394:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60279 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.791402:0:9245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d60280 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.791411:0:9245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d60280 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.791415:0:9245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d60280 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.791417:0:9245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998800 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081698.791419:0:9245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d60280 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.791422:0:9245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d60280 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.791426:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e10d046f600) 00010000:00010000:3.0:1789081698.791428:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081698.791429:0:9245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d60280 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.791433:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d60280 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.791447:0:9245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60287 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.791452:0:9245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60287 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.791457:0:9245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60287 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.791462:0:9245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998000 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081698.791470:0:9245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60287 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.791477:0:9245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60287 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.791485:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d19d3f00) 00010000:00010000:3.0:1789081698.791487:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081698.791489:0:9245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60287 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.791492:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60287 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081698.791595:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+52:11469:x1875987796141440:12345-192.168.201.17@tcp:34:lfs.0 Request processed in 489us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081698.791602:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 164 00000100:00100000:2.0:1789081698.793145:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081698.793188:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796141696 00000100:00100000:1.0:1789081698.793196:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796141696 00000100:00100000:1.0:1789081698.793237:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 46 00000100:00100000:1.0:1789081698.793242:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+52:11469:x1875987796141696:12345-192.168.201.17@tcp:35:lfs.0 00000100:00100000:1.0:1789081698.793437:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+53:11469:x1875987796141696:12345-192.168.201.17@tcp:35:lfs.0 Request processed in 193us (295us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1789081698.793444:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 46 00000100:00100000:2.0:1789081698.825270:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081698.825364:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796141952 00000100:00100000:1.0:1789081698.825373:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796141952 00000100:00100000:1.0:1789081698.825419:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 165 00000100:00100000:1.0:1789081698.825427:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+53:11472:x1875987796141952:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:1.0:1789081698.825447:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081698.825469:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d6028e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2aad4 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.825693:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d60295 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.825707:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d60295 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.825715:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d60295 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.825726:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d6029c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.825738:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d6029c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.825742:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d6029c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.825848:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d602a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.825853:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d602a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.825857:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d602a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789081698.825864:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789081698.825936:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d60295 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.825941:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d60295 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.825946:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d60295 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.825949:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13aec00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081698.825952:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d60295 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.825957:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d60295 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.825972:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e10c7ecf100) 00010000:00010000:1.0:1789081698.825974:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789081698.825977:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d60295 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.825981:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d60295 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.825991:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d6029c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.825994:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d6029c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.825998:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d6029c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.826001:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13aee00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081698.826003:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d6029c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.826006:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d6029c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.826009:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e10c7ecfa00) 00010000:00010000:1.0:1789081698.826011:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789081698.826012:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d6029c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.826015:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d6029c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.826051:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d6028e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aad4 expref: 56 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.826060:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d602a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aad4 expref: 55 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.826065:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d19d3f00) 00010000:00010000:1.0:1789081698.826066:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789081698.826068:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13af600, rc 0) 00000100:00100000:1.0:1789081698.826120:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+55:11472:x1875987796141952:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 693us (859us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1789081698.826127:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 165 00000100:00100000:2.0:1789081698.833624:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081698.833714:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796142080 00000100:00100000:1.0:1789081698.833723:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796142080 00000100:00100000:1.0:1789081698.833774:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 166 00000100:00100000:1.0:1789081698.833781:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff647b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+55:11472:x1875987796142080:12345-192.168.201.17@tcp:54:lfs.0 00010000:00010000:1.0:1789081698.833844:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d602b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.833857:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d602b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.833865:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d602b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.833886:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d602b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.833904:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d602b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.833909:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d602b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.833912:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13afe00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081698.833915:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d602b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.833921:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d602b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.833928:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d19d3f00) 00010000:00010000:1.0:1789081698.833930:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789081698.833933:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d602b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081698.833937:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d602b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081698.833995:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff647b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+55:11472:x1875987796142080:12345-192.168.201.17@tcp:54:lfs.0 Request processed in 214us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081698.834000:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 166 00000100:00100000:2.0:1789081698.837180:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081698.837365:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796142336 00000100:00100000:1.0:1789081698.837373:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796142336 00000100:00100000:1.0:1789081698.837446:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 47 00000100:00100000:1.0:1789081698.837454:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+55:11472:x1875987796142336:12345-192.168.201.17@tcp:35:lfs.0 00000100:00100000:1.0:1789081698.837707:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+56:11472:x1875987796142336:12345-192.168.201.17@tcp:35:lfs.0 Request processed in 254us (533us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1789081698.837723:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 47 00000100:00100000:2.0:1789081698.845260:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081698.845382:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796142464 00000100:00100000:3.0:1789081698.845391:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796142464 00000100:00100000:3.0:1789081698.845462:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 13 00000100:00100000:3.0:1789081698.845472:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5a6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41476931-e751-413e-b98c-64d4d0edcd05+56:2351:x1875987796142464:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789081698.845485:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081698.845509:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d602a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aad4 expref: 56 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.845543:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d19d3f00) 00010000:00010000:3.0:1789081698.845549:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789081698.845600:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5a6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41476931-e751-413e-b98c-64d4d0edcd05+55:2351:x1875987796142464:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 130us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081698.845624:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 13 00000100:00100000:2.0:1789081698.978612:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081698.978754:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796142720 00000100:00100000:3.0:1789081698.978765:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796142720 00000100:00100000:3.0:1789081698.978869:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 167 00000100:00100000:3.0:1789081698.978880:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5a68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+55:11490:x1875987796142720:12345-192.168.201.17@tcp:101:cat.0 00010000:00010000:3.0:1789081698.978903:0:9245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081698.978926:0:9245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d602b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2aadb expref: -99 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.979047:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d602bf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.979062:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d602bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.979084:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d602bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789081698.979096:0:9245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789081698.979324:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d602b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aadb expref: 58 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.979343:0:9245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d602bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aadb expref: 57 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081698.979352:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d19d3f00) 00010000:00010000:3.0:1789081698.979354:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789081698.979358:0:9245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101998800, rc 0) 00000100:00100000:3.0:1789081698.979481:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5a68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+57:11490:x1875987796142720:12345-192.168.201.17@tcp:101:cat.0 Request processed in 603us (982us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1789081698.979489:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 167 00000100:00100000:2.0:1789081699.007042:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081699.010960:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796142848 00000100:00100000:1.0:1789081699.010975:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796142848 00000100:00100000:1.0:1789081699.011065:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 168 00000100:00100000:1.0:1789081699.011076:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+57:11491:x1875987796142848:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:1.0:1789081699.011101:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081699.011121:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d602cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2aae2 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.011197:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d602d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.011211:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d602d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.011223:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d602d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789081699.011277:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1789081699.011282:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1789081699.011307:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d602d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.011343:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d602cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aae2 expref: 59 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.011363:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d602d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aae2 expref: 58 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.011389:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e10c7ecf100) 00010000:00010000:1.0:1789081699.011392:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789081699.011396:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13aee00, rc 0) 00000100:00100000:1.0:1789081699.011467:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+58:11491:x1875987796142848:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 393us (4434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081699.011475:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 168 00000100:00100000:2.0:1789081699.018745:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081699.018854:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796143232 00000100:00100000:3.0:1789081699.018865:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796143232 00000100:00100000:3.0:1789081699.018922:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 48 00000100:00100000:3.0:1789081699.018933:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5a69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+58:11491:x1875987796143232:12345-192.168.201.17@tcp:35:lfs.0 00000100:00100000:3.0:1789081699.019265:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5a69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+59:11491:x1875987796143232:12345-192.168.201.17@tcp:35:lfs.0 Request processed in 333us (540us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1789081699.019274:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 48 00000100:00100000:2.0:1789081699.024461:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081699.024598:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796143360 00000100:00100000:3.0:1789081699.024608:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796143360 00000100:00100000:3.0:1789081699.024689:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 14 00000100:00100000:3.0:1789081699.024700:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c938b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41476931-e751-413e-b98c-64d4d0edcd05+59:11491:x1875987796143360:12345-192.168.201.17@tcp:103:lfs.0 00010000:00010000:3.0:1789081699.024716:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789081699.024743:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d60264 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aac6 expref: 59 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.024764:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d602bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aadb expref: 58 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.024776:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d6016f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa87 expref: 57 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.024786:0:7481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d19d3f00) 00010000:00010000:3.0:1789081699.024795:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789081699.024869:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c938b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41476931-e751-413e-b98c-64d4d0edcd05+56:11491:x1875987796143360:12345-192.168.201.17@tcp:103:lfs.0 Request processed in 171us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081699.024876:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 14 00000100:00100000:2.0:1789081699.028452:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081699.028757:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796143488 00000100:00100000:0.0:1789081699.028767:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796143488 00000100:00100000:0.0:1789081699.029211:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 169 00000100:00100000:0.0:1789081699.029223:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5a68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+56:11491:x1875987796143488:12345-192.168.201.17@tcp:58:lfs.0 00010000:00010000:0.0:1789081699.029328:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d602db lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.029353:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d602db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.029366:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d602db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789081699.029601:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1789081699.029773:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5a68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+56:11491:x1875987796143488:12345-192.168.201.17@tcp:58:lfs.0 Request processed in 552us (1338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081699.029782:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 169 00000100:00100000:2.0:1789081699.081959:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081699.082194:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796143616 00000100:00100000:3.0:1789081699.082203:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796143616 00000100:00100000:3.0:1789081699.082421:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 170 00000100:00100000:3.0:1789081699.082442:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+56:11493:x1875987796143616:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:3.0:1789081699.082464:0:9245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081699.082487:0:9245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d602e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2aae9 expref: -99 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.082827:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d602e9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.082843:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d602e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.082855:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d602e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.082872:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d602f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.082880:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d602f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.082887:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d602f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.082985:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d602f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.082995:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d602f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.083064:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d602f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789081699.083101:0:9245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789081699.083105:0:9245:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789081699.083123:0:9245:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d602f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.083134:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d602f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.083157:0:9245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d602e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.083164:0:9245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d602e9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.083171:0:9245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d602e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.083177:0:9245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101775000 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081699.083181:0:9245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d602e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.083188:0:9245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d602e9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.083199:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e10c7ecf100) 00010000:00010000:2.0:1789081699.083203:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081699.083207:0:9245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d602e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.083213:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d602e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.083226:0:9245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d602f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.083233:0:9245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d602f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.083239:0:9245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d602f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.083250:0:9245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101774400 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081699.083253:0:9245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d602f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.083259:0:9245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d602f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.083398:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e10c9a92900) 00010000:00010000:2.0:1789081699.083401:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081699.083404:0:9245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d602f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.083411:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d602f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.083446:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d602e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aae9 expref: 58 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.083461:0:9245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d602f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aae9 expref: 57 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.083467:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d19d3600) 00010000:00010000:2.0:1789081699.083470:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789081699.083472:0:9245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101775600, rc 0) 00000100:00100000:2.0:1789081699.083885:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+57:11493:x1875987796143616:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 1454us (1933us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081699.083893:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 170 00010000:00010000:0.0:1789081699.105026:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789081699.292880:0:11539:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789081699.292889:0:11539:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789081699.292930:0:11539:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1789081699.292938:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789081699.293066:0:11539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b6680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11539:1875987821305984:192.168.201.17@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789081699.293169:0:11539:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10f95bcd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789081699.312333:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081699.312635:0:11539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b6680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11539:1875987821305984:192.168.201.17@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789081699.315227:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796143744 00000100:00100000:3.0:1789081699.315243:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796143744 00000100:00100000:3.0:1789081699.315431:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 171 00000100:00100000:3.0:1789081699.315444:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5a6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+57:11504:x1875987796143744:12345-192.168.201.17@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789081699.315481:0:5789:0:(mdt_handler.c:8081:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789081699.315611:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5a6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+57:11504:x1875987796143744:12345-192.168.201.17@tcp:53:lhsmtool_posix.0 Request processed in 170us (3289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081699.315620:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 171 00000100:00100000:2.0:1789081699.321720:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081699.321816:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796143872 00000100:00100000:3.0:1789081699.321884:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796143872 00000100:00100000:3.0:1789081699.321970:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 172 00000100:00100000:3.0:1789081699.321978:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5a6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+57:11504:x1875987796143872:12345-192.168.201.17@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789081699.322047:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d602fe lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.322073:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d602fe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.322097:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d602fe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.322114:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60305 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.322122:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60305 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.322128:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60305 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.322150:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d6030c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.322155:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d6030c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.322160:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d6030c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789081699.322191:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789081699.322194:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789081699.322204:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d6030c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.322212:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d602fe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.322216:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d602fe lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.322242:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d602fe lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.322248:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998000 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081699.322252:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d602fe lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.322260:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d602fe lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.322272:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e10d046fc00) 00010000:00010000:3.0:1789081699.322275:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081699.322280:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d602fe lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.322295:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d602fe lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.322306:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60305 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.322309:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60305 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.322313:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60305 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.322316:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999e00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081699.322318:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60305 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.322328:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60305 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.322334:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9e10d046f600) 00010000:00010000:3.0:1789081699.322335:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081699.322337:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60305 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.322341:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60305 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.322350:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d6030c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.322354:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d6030c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.322357:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d6030c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.322360:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999000 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081699.322361:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d6030c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.322364:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d6030c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.322368:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d19d3600) 00010000:00010000:3.0:1789081699.322369:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081699.322371:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d6030c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.322380:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d6030c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081699.322450:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5a6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+57:11504:x1875987796143872:12345-192.168.201.17@tcp:34:lhsmtool_posix.0 Request processed in 472us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081699.322455:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 172 00000100:00100000:1.0:1789081699.325363:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081699.325418:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796144128 00000100:00100000:2.0:1789081699.325434:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796144128 00000100:00100000:2.0:1789081699.325489:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 173 00000100:00100000:2.0:1789081699.325500:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+57:11504:x1875987796144128:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789081699.325519:0:9245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081699.325553:0:9245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d60313 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2aaf0 expref: -99 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.325660:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775e00/0xb7cb3d7479d6031a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.325675:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775e00/0xb7cb3d7479d6031a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.325687:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775e00/0xb7cb3d7479d6031a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789081699.325699:0:9245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789081699.325809:0:9245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775e00/0xb7cb3d7479d6031a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.325814:0:9245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775e00/0xb7cb3d7479d6031a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.325819:0:9245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775e00/0xb7cb3d7479d6031a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.325831:0:9245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101775e00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081699.325836:0:9245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775e00/0xb7cb3d7479d6031a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.325860:0:9245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775e00/0xb7cb3d7479d6031a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.325873:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d19d3600) 00010000:00010000:2.0:1789081699.325876:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789081699.325881:0:9245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775e00/0xb7cb3d7479d6031a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.325887:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775e00/0xb7cb3d7479d6031a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.326088:0:9245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d60313 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aaf0 expref: 59 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.326098:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e10d046fc00) 00010000:00010000:2.0:1789081699.326100:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789081699.326103:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d60313 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aaf0 expref: 59 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.326110:0:9245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101774600, rc 0) 00000100:00100000:2.0:1789081699.326160:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+58:11504:x1875987796144128:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 663us (807us total) trans 4294967458 rc 301/301 00000100:00100000:2.0:1789081699.326166:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 173 00000100:00100000:2.0:1789081699.329149:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081699.329202:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796144256 00000100:00100000:3.0:1789081699.329212:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796144256 00000100:00100000:3.0:1789081699.329343:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 174 00000100:00100000:3.0:1789081699.329353:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5a6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+58:11504:x1875987796144256:12345-192.168.201.17@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789081699.329390:0:5789:0:(mdt_handler.c:8081:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789081699.329497:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5a6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+58:11504:x1875987796144256:12345-192.168.201.17@tcp:53:lhsmtool_posix.0 Request processed in 145us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081699.329508:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 174 00000100:00100000:1.0:1789081699.337421:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081699.337500:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796144512 00000100:00100000:3.0:1789081699.337511:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796144512 00000100:00100000:3.0:1789081699.337641:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 175 00000100:00100000:3.0:1789081699.337652:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+58:11504:x1875987796144512:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789081699.337677:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081699.337680:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789081699.337707:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d602d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aae2 expref: 58 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.337723:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e10c7ecf100) 00010000:00010000:3.0:1789081699.337729:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789081699.337743:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d60328 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2aaf7 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789081699.341790:0:5791:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1789081699.342183:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d6032f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.342209:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d6032f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.342219:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d6032f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.342291:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d60328 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aaf7 expref: 60 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.342304:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d6032f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aaf7 expref: 59 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.342311:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e10c9a92900) 00010000:00010000:2.0:1789081699.342313:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789081699.342315:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101774600, rc 0) 00000100:00100000:2.0:1789081699.342423:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+59:11504:x1875987796144512:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 4767us (5006us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1789081699.342430:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 175 00000100:00100000:3.0:1789081699.346816:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081699.347021:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796144768 00000100:00100000:0.0:1789081699.347032:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796144768 00000100:00100000:0.0:1789081699.347131:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 176 00000100:00100000:0.0:1789081699.347142:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f98d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+59:11504:x1875987796144768:12345-192.168.201.17@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789081699.347211:0:9245:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789081699.347239:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774600/0xb7cb3d7479d6032f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aaf7 expref: 59 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.347258:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e10c9a92900) 00010000:00010000:0.0:1789081699.347269:0:9245:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789081699.347292:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d6033d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.347307:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d6033d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.347317:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d6033d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.347348:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60344 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xde9b00cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.347356:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60344 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xde9b00cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.347363:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60344 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xde9b00cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.347429:0:9245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d6033d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.347436:0:9245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d6033d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.347443:0:9245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d6033d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.347448:0:9245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101983800 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081699.347452:0:9245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d6033d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.347459:0:9245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d6033d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.347468:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e10c7ecf100) 00010000:00010000:0.0:1789081699.347471:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081699.347474:0:9245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d6033d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.347480:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d6033d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.347496:0:9245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60344 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xde9b00cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.347502:0:9245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60344 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xde9b00cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.347509:0:9245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60344 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xde9b00cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.347514:0:9245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101982600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081699.347517:0:9245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60344 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xde9b00cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.347557:0:9245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60344 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xde9b00cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.347565:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xde9b00cc (ffff9e10d19d3f00) 00010000:00010000:0.0:1789081699.347568:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081699.347571:0:9245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60344 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xde9b00cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.347576:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60344 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xde9b00cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081699.347666:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f98d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+58:11504:x1875987796144768:12345-192.168.201.17@tcp:36:lhsmtool_posix.0 Request processed in 525us (858us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789081699.347674:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 176 00000100:00100000:0.0:1789081699.349354:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081699.349647:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796144896 00000100:00100000:1.0:1789081699.349656:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796144896 00000100:00100000:1.0:1789081699.349835:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 177 00000100:00100000:1.0:1789081699.350012:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+58:11504:x1875987796144896:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789081699.350034:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081699.350065:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d6034b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2aafe expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.350098:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d60352 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.350123:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d60352 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.350134:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d60352 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.350225:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d6034b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aafe expref: 60 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.350242:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d60352 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aafe expref: 59 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.350251:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e10c7ecfa00) 00010000:00010000:1.0:1789081699.350254:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789081699.350257:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13afe00, rc 0) 00000100:00100000:1.0:1789081699.350310:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+59:11504:x1875987796144896:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 467us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081699.350318:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 177 00000100:00100000:3.0:1789081699.353915:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081699.354004:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796145152 00000100:00100000:2.0:1789081699.354013:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796145152 00000100:00100000:2.0:1789081699.354070:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 178 00000100:00100000:2.0:1789081699.354080:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f98d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+59:11504:x1875987796145152:12345-192.168.201.17@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789081699.354154:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d60359 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.354166:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d60359 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.354191:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d60359 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789081699.354411:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:2.0:1789081699.354428:0:5791:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 366236903804ns, next at 367236901036ns, rc = 0 00000004:00010000:2.0:1789081699.354503:0:5791:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006e413000 reply state 0000000055ab09d7 transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d60359 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081699.354510:0:5791:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789081699.354603:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f98d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+61:11504:x1875987796145152:12345-192.168.201.17@tcp:36:lhsmtool_posix.0 Request processed in 525us (696us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1789081699.354608:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 178 00010000:00010000:3.0:1789081699.355723:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d60359 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.355735:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d60359 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.355743:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d60359 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.355748:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101775c00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081699.355760:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d60359 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.355766:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d60359 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.355778:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e10c7ecfa00) 00010000:00010000:3.0:1789081699.355780:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789081699.355783:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d60359 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.355787:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d60359 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081699.360268:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081699.360600:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796145280 00000100:00100000:0.0:1789081699.360610:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796145280 00000100:00100000:0.0:1789081699.360701:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 179 00000100:00100000:0.0:1789081699.360711:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f98d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+60:11504:x1875987796145280:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789081699.360751:0:9245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081699.362257:0:9245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60360 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ab05 expref: -99 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.362331:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60360 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab05 expref: 61 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.362348:0:9245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60360 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab05 expref: 61 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.362368:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e10c7ecfa00) 00010000:00010000:0.0:1789081699.362371:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789081699.362375:0:9245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101982600, rc 0) 00000100:00100000:0.0:1789081699.362467:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f98d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+61:11504:x1875987796145280:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 1756us (2207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081699.362475:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 179 00000100:00100000:2.0:1789081699.367643:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081699.368331:0:7788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796145408 00000100:00100000:1.0:1789081699.368344:0:7788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796145408 00000100:00080000:3.0:1789081699.368397:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789081699.368433:0:7788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 50 00000100:00100000:1.0:1789081699.368446:0:7788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1029500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41476931-e751-413e-b98c-64d4d0edcd05+6:2351:x1875987796145408:12345-192.168.201.17@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789081699.369186:0:7788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1029500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41476931-e751-413e-b98c-64d4d0edcd05+7:2351:x1875987796145408:12345-192.168.201.17@tcp:2:lhsmtool_posix.0 Request processed in 741us (1562us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1789081699.369196:0:7788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 50 00000100:00100000:2.0:1789081699.386581:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081699.386667:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796145664 00000100:00100000:1.0:1789081699.386691:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796145664 00000100:00100000:2.0:1789081699.387022:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 49 00000100:00100000:2.0:1789081699.387043:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1029c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+61:11504:x1875987796145664:12345-192.168.201.17@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789081699.387327:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1029c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+62:11504:x1875987796145664:12345-192.168.201.17@tcp:35:lhsmtool_posix.0 Request processed in 296us (756us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1789081699.387336:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 49 00000100:00100000:2.0:1789081699.395075:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081699.395156:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796145920 00000100:00100000:1.0:1789081699.395166:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796145920 00000100:00100000:1.0:1789081699.395274:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 180 00000100:00100000:1.0:1789081699.395286:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d102a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+62:11504:x1875987796145920:12345-192.168.201.17@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789081699.395417:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d102a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+62:11504:x1875987796145920:12345-192.168.201.17@tcp:57:lhsmtool_posix.0 Request processed in 133us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081699.395425:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 180 00000100:00100000:3.0:1789081699.402914:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081699.404501:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796146048 00000100:00100000:0.0:1789081699.404511:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796146048 00000100:00100000:0.0:1789081699.404613:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 181 00000100:00100000:0.0:1789081699.404654:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f98d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+62:11504:x1875987796146048:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789081699.404677:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081699.404700:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d60367 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ab0c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.404767:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d6036e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.404793:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d6036e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.404804:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d6036e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789081699.404840:0:5789:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789081699.404859:0:5789:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d6036e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.404885:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d60367 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab0c expref: 64 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.404905:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d6036e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab0c expref: 63 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.404914:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e10c7ecfa00) 00010000:00010000:0.0:1789081699.404917:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789081699.404921:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101983000, rc 0) 00000100:00100000:0.0:1789081699.404993:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f98d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+63:11504:x1875987796146048:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 370us (2095us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081699.405000:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 181 00000100:00100000:0.0:1789081699.418413:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081699.418568:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796146176 00000100:00100000:3.0:1789081699.418590:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796146176 00000100:00100000:3.0:1789081699.418666:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 51 00000100:00100000:3.0:1789081699.418677:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c8a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+7:2350:x1875987796146176:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789081699.418696:0:6584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081699.418717:0:6584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009944c9fc/0xb7cb3d7479d60375 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ab13 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789081699.418744:0:6584:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa33863, blocks: 0x1 00010000:00010000:3.0:1789081699.418764:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=366s v=(0 0) 00010000:00010000:3.0:1789081699.418769:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081699.418779:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009944c9fc/0xb7cb3d7479d60375 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab13 expref: 8 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.418807:0:6584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009944c9fc/0xb7cb3d7479d60375 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab13 expref: 8 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.418821:0:6584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101999e00, rc 0) 00000100:00100000:3.0:1789081699.418874:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c8a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+8:2350:x1875987796146176:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 200us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081699.418882:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 51 00000100:00100000:3.0:1789081699.427321:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081699.427413:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796146432 00000100:00100000:0.0:1789081699.427423:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796146432 00000100:00100000:0.0:1789081699.427497:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 182 00000100:00100000:0.0:1789081699.427508:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f98d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+63:11504:x1875987796146432:12345-192.168.201.17@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789081699.427661:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f98d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+63:11504:x1875987796146432:12345-192.168.201.17@tcp:57:lhsmtool_posix.0 Request processed in 154us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081699.427687:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 182 00000100:00100000:3.0:1789081699.441933:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081699.442093:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796146560 00000100:00100000:2.0:1789081699.442101:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796146560 00000100:00100000:2.0:1789081699.442436:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 52 00000100:00100000:2.0:1789081699.442450:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f98d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41476931-e751-413e-b98c-64d4d0edcd05+8:11504:x1875987796146560:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789081699.442469:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081699.442499:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf53e6e6/0xb7cb3d7479d6037c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ab1a expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.442551:0:6581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009944c9fc/0xb7cb3d7479d60375 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab13 expref: 9 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.442560:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789081699.442564:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789081699.442569:0:6581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf53e6e6/0xb7cb3d7479d6037c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab1a expref: 9 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.442602:0:6581:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009944c9fc/0xb7cb3d7479d60375 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab13 expref: 9 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.442615:0:6581:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009944c9fc/0xb7cb3d7479d60375 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab13 expref: 9 pid: 6584 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081699.444369:0:6581:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d1028000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6581:1875987821306112:192.168.201.17@tcp:104: 00000100:00100000:2.0:1789081699.444471:0:6581:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10e09bad80 going to sleep for 11 seconds 00000100:00100000:1.0:1789081699.453597:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081699.453609:0:6581:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d1028000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6581:1875987821306112:192.168.201.17@tcp:104: 00000100:00100000:1.0:1789081699.453639:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796146688 00000100:00100000:1.0:1789081699.453645:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796146688 00010000:00010000:3.0:1789081699.453652:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cf53e6e6/0xb7cb3d7479d6037c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab1a expref: 10 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.453679:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009944c9fc/0xb7cb3d7479d60375 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab13 expref: 10 pid: 6584 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.453696:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101774600, rc 0) 00000100:00100000:1.0:1789081699.453710:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 69 00000100:00100000:1.0:1789081699.453718:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41476931-e751-413e-b98c-64d4d0edcd05+10:2350:x1875987796146688:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789081699.453731:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789081699.453746:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f98d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41476931-e751-413e-b98c-64d4d0edcd05+10:11504:x1875987796146560:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 11303us (11837us total) trans 0 rc 0/0 00010000:00010000:1.0:1789081699.453752:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009944c9fc/0xb7cb3d7479d60375 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab13 expref: 10 pid: 6584 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081699.453754:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 52 00010000:00010000:1.0:1789081699.453763:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009944c9fc/0xb7cb3d7479d60375 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab13 expref: 10 pid: 6584 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.453787:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009944c9fc/0xb7cb3d7479d60375 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab13 expref: 9 pid: 6584 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.453808:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789081699.453813:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789081699.453821:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf53e6e6/0xb7cb3d7479d6037c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab1a expref: 8 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.453831:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf53e6e6/0xb7cb3d7479d6037c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab1a expref: 8 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.453865:0:5776:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000cf53e6e6/0xb7cb3d7479d6037c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab1a expref: 8 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081699.453879:0:5776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5776:1875987821306240:192.168.201.17@tcp:105: 00000100:00100000:1.0:1789081699.453937:0:5776:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10f95bcd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789081699.470133:0:5776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5776:1875987821306240:192.168.201.17@tcp:105: 00010000:00010000:1.0:1789081699.470156:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789081699.470217:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41476931-e751-413e-b98c-64d4d0edcd05+8:2350:x1875987796146688:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 16498us (16628us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081699.470227:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 69 00000100:00100000:1.0:1789081699.473831:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081699.473918:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796146816 00000100:00100000:2.0:1789081699.473928:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796146816 00002000:00100000:2.0:1789081699.473990:0:6589:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9e11010b4000 x1875987796146816/t0(0) o4->41476931-e751-413e-b98c-64d4d0edcd05@192.168.201.17@tcp:490/0 lens 504/0 e 0 to 0 dl 1789081710 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789081699.474002:0:6589:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e11010b4000 with x1875987796146816 ext(0->8) 00002000:00010000:2.0:1789081699.474008:0:6589:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e11010b4000 00000100:00100000:2.0:1789081699.474043:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 4 00000100:00100000:2.0:1789081699.474061:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41476931-e751-413e-b98c-64d4d0edcd05+8:2349:x1875987796146816:12345-192.168.201.17@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789081699.474570:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41476931-e751-413e-b98c-64d4d0edcd05+10:2349:x1875987796146816:12345-192.168.201.17@tcp:4:lhsmtool_posix.0 Request processed in 508us (752us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789081699.474580:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 4 00002000:00100000:2.0:1789081699.474589:0:6589:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9e11010b4000 x1875987796146816/t4294967314(0) o4->41476931-e751-413e-b98c-64d4d0edcd05@192.168.201.17@tcp:490/0 lens 504/448 e 0 to 0 dl 1789081710 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789081699.474599:0:6589:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e11010b4000 with x1875987796146816 ext(0->8) 00002000:00010000:2.0:1789081699.474603:0:6589:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e11010b4000 00000100:00100000:1.0:1789081699.481191:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081699.481359:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796146944 00000100:00100000:2.0:1789081699.481369:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796146944 00000100:00100000:2.0:1789081699.481520:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 183 00000100:00100000:2.0:1789081699.481554:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d16c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+63:11504:x1875987796146944:12345-192.168.201.17@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789081699.539679:0:5811:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967445 is committed 00000001:00080000:0.0:1789081699.539718:0:5811:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967455 is committed 00000001:00080000:0.0:1789081699.539740:0:5811:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000004:00080000:0.0:1789081699.539746:0:5811:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:0.0:1789081699.539768:0:5811:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1789081699.539784:0:5811:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e10c66823c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1789081699.539789:0:5811:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e10ffb02100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e10c66829c0 00000020:00080000:0.0:1789081699.539792:0:5811:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e10f573d300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e10ff643c00 00000020:00080000:0.0:1789081699.539997:0:5822:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1789081699.540152:0:5822:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1789081699.540161:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789081699.540180:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c8a1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821306368:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789081699.540244:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d16c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+18:11504:x1875987796146944:12345-192.168.201.17@tcp:44:lhsmtool_posix.0 Request processed in 58689us (59058us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081699.540255:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 183 00000100:00100000:0.0:1789081699.540573:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081699.540694:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c8a1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821306496:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789081699.540723:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081699.540758:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821306368 00000100:00100000:0.0:1789081699.540765:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821306368 00000100:00100000:0.0:1789081699.540808:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821306496 00000100:00100000:0.0:1789081699.540811:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821306496 00000100:00100000:0.0:1789081699.540830:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789081699.540838:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c8a1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821306368:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789081699.540964:0:6582:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789081699.540968:0:6582:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789081699 00002000:00010000:0.0:1789081699.540970:0:6582:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789081699.540973:0:6582:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789081699 -> 1789081699 00002000:00010000:0.0:1789081699.540986:0:6582:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789081699.541018:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c8a1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1875987821306368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 181us (446us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1789081699.541025:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789081699.541038:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789081699.541045:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1875987821306496:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789081699.541059:0:6582:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1789081699.541085:0:6582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa33860, atime: 0x6aa33861, ctime: 0x6aa33860, blocks: 0x1 00010000:00010000:0.0:1789081699.541093:0:6582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac5aba84/0xb7cb3d7479d60383 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.541108:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=366s v=(0 0) 00010000:00010000:0.0:1789081699.541112:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789081699.541119:0:6582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac5aba84/0xb7cb3d7479d60383 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.541135:0:6582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac5aba84/0xb7cb3d7479d60383 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.541146:0:6582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac5aba84/0xb7cb3d7479d60383 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.541154:0:6582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac5aba84/0xb7cb3d7479d60383 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.541172:0:6582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789081699.542394:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3303:x1875987821306496:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1346us (1667us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789081699.542411:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1789081699.542444:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789081699.542448:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789081699.542463:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789081699.542469:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac5aba84/0xb7cb3d7479d60383 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.542478:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101983600 already unused, calling callback (ffffffffc1784220) 00010000:00010000:0.0:1789081699.542483:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac5aba84/0xb7cb3d7479d60383 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.542491:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac5aba84/0xb7cb3d7479d60383 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.542508:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac5aba84/0xb7cb3d7479d60383 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.542515:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac5aba84/0xb7cb3d7479d60383 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.542556:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081699.542558:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081699.542560:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789081699.542590:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e10c8a1ca80/2, rc 0, transno 4294967315 00000100:00100000:0.0:1789081699.542597:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c8a1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821306368:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1789081699.542777:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e10c8a1c700/2, rc 0, transno 4294967307 00000100:00100000:1.0:1789081699.542783:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c8a1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821306496:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789081699.552196:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081699.558573:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796147072 00000100:00100000:3.0:1789081699.558589:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796147072 00000100:00100000:3.0:1789081699.558670:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 55 00000100:00100000:3.0:1789081699.558682:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+10:2351:x1875987796147072:12345-192.168.201.17@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1789081699.657601:0:7493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:1.0:1789081699.657644:0:7493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:1.0:1789081699.657651:0:7493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:0.0:1789081699.657866:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+7:2351:x1875987796147072:12345-192.168.201.17@tcp:16:lhsmtool_posix.0 Request processed in 99180us (105673us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081699.657884:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 55 00000100:00100000:2.0:1789081699.674175:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081699.674473:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796147328 00000100:00100000:3.0:1789081699.674484:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796147328 00000100:00100000:2.0:1789081699.675172:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 184 00000100:00100000:2.0:1789081699.675186:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1028700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+18:11504:x1875987796147328:12345-192.168.201.17@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789081699.675247:0:7252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789081699.675276:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d6036e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab0c expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.675297:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e10c7ecfa00) 00010000:00010000:2.0:1789081699.675302:0:7252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789081699.675352:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d6038a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.675366:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d6038a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.675376:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d6038a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789081699.675697:0:7252:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000040f61df3 reply state 00000000eb79ec11 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d6038a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081699.675707:0:7252:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789081699.675812:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1028700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+19:11504:x1875987796147328:12345-192.168.201.17@tcp:36:lhsmtool_posix.0 Request processed in 630us (1648us total) trans 4294967462 rc 0/0 00000100:00100000:2.0:1789081699.675820:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 184 00010000:00010000:0.0:1789081699.683034:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d6038a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.683053:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d6038a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.683061:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d6038a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.683067:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101775000 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081699.683073:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d6038a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.683081:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d6038a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.683100:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e10c7ecfa00) 00010000:00010000:0.0:1789081699.683103:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081699.683108:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d6038a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.683116:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d6038a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081699.683877:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081699.683933:0:7788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796147456 00000100:00100000:0.0:1789081699.683947:0:7788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796147456 00000100:00100000:0.0:1789081699.684020:0:7788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 56 00000100:00100000:0.0:1789081699.684036:0:7788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1028000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41476931-e751-413e-b98c-64d4d0edcd05+7:2350:x1875987796147456:12345-192.168.201.17@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789081699.684302:0:7788:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1789081699.684322:0:7788:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789081699 -> 1789081698 00002000:00010000:0.0:1789081699.684326:0:7788:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789081697 00002000:00010000:0.0:1789081699.684328:0:7788:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789081699 -> 1789081698 00002000:00010000:0.0:1789081699.684330:0:7788:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789081699.684396:0:7788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1028000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41476931-e751-413e-b98c-64d4d0edcd05+8:2350:x1875987796147456:12345-192.168.201.17@tcp:2:lhsmtool_posix.0 Request processed in 364us (531us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789081699.684405:0:7788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 56 00000100:00100000:1.0:1789081699.690433:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081699.690572:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796147712 00000100:00100000:3.0:1789081699.690585:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796147712 00000100:00100000:3.0:1789081699.690673:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 185 00000100:00100000:3.0:1789081699.690685:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+18:11504:x1875987796147712:12345-192.168.201.17@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789081699.690804:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d60391 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.690825:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d60352 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aafe expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.690837:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d60391 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.690887:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d60352 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aafe expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.690940:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d60352 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aafe expref: 18 pid: 5790 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081699.690957:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9486680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5791:1875987821306624:192.168.201.17@tcp:104: 00000100:00100000:3.0:1789081699.691094:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d1543f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789081699.699772:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081699.699772:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9486680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5791:1875987821306624:192.168.201.17@tcp:104: 00010000:00010000:2.0:1789081699.699810:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d60391 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081699.700017:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796147840 00000100:00100000:1.0:1789081699.700027:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796147840 00010000:00010000:1.0:1789081699.700077:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d60352 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aafe expref: 19 pid: 5790 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081699.700126:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 70 00000100:00100000:1.0:1789081699.700136:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff646680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41476931-e751-413e-b98c-64d4d0edcd05+19:2351:x1875987796147840:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789081699.700157:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789081699.700164:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d60352 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aafe expref: 19 pid: 5790 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.700177:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d60352 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aafe expref: 19 pid: 5790 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.700208:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d60352 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aafe expref: 19 pid: 5790 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.700226:0:7481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e10c7ecfa00) 00010000:00010000:1.0:1789081699.700231:0:7481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d60391 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.700242:0:7481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d60391 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.700250:0:7481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d60391 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.700301:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789081699.700370:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff646680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41476931-e751-413e-b98c-64d4d0edcd05+18:2351:x1875987796147840:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 234us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081699.700379:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 70 00010000:00010000:3.0:1789081699.700794:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d60391 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.700804:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d60391 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.700843:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d60391 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.700851:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d60391 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.700857:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d60391 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.700863:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081699.700868:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d60391 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.700876:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d60391 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.700887:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e10c7ecfa00) 00010000:00010000:3.0:1789081699.700900:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789081699.700915:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d60391 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.700923:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d60391 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081699.700993:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+17:11504:x1875987796147712:12345-192.168.201.17@tcp:55:lhsmtool_posix.0 Request processed in 10309us (10577us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789081699.701003:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 185 00000100:00100000:1.0:1789081699.703410:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081699.703654:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796147968 00000100:00100000:2.0:1789081699.703669:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796147968 00000100:00100000:2.0:1789081699.703744:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 57 00000100:00100000:2.0:1789081699.703754:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41476931-e751-413e-b98c-64d4d0edcd05+8:2350:x1875987796147968:12345-192.168.201.17@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789081699.703825:0:6582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000157031f9/0xb7cb3d7479d60398 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.703851:0:6582:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf53e6e6/0xb7cb3d7479d6037c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab1a expref: 8 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.703881:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789081699.703886:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789081699.703891:0:6582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000157031f9/0xb7cb3d7479d60398 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.703938:0:6582:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cf53e6e6/0xb7cb3d7479d6037c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab1a expref: 8 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.703953:0:6582:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cf53e6e6/0xb7cb3d7479d6037c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab1a expref: 8 pid: 6581 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081699.703972:0:6582:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9486680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6582:1875987821306752:192.168.201.17@tcp:104: 00000100:00100000:2.0:1789081699.704090:0:6582:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0fc2a360c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789081699.713014:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081699.713110:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796148096 00000100:00100000:1.0:1789081699.713125:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796148096 00010000:00010000:1.0:1789081699.713183:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cf53e6e6/0xb7cb3d7479d6037c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab1a expref: 9 pid: 6581 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081699.713238:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 71 00000100:00100000:1.0:1789081699.713248:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f96e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41476931-e751-413e-b98c-64d4d0edcd05+9:2350:x1875987796148096:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789081699.713272:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789081699.713308:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cf53e6e6/0xb7cb3d7479d6037c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab1a expref: 9 pid: 6581 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.713324:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cf53e6e6/0xb7cb3d7479d6037c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab1a expref: 9 pid: 6581 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.713360:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789081699.713365:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789081699.713372:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000157031f9/0xb7cb3d7479d60398 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.713384:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000157031f9/0xb7cb3d7479d60398 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.713428:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789081699.713502:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f96e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41476931-e751-413e-b98c-64d4d0edcd05+9:2350:x1875987796148096:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 255us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081699.713510:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 71 00010000:00010000:0.0:1789081699.713810:0:6582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf53e6e6/0xb7cb3d7479d6037c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab1a expref: 8 pid: 6581 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081699.713829:0:6582:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9486680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6582:1875987821306752:192.168.201.17@tcp:104: 00010000:00010000:0.0:1789081699.713856:0:6582:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000157031f9/0xb7cb3d7479d60398 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.713868:0:6582:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000157031f9/0xb7cb3d7479d60398 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.713877:0:6582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000157031f9/0xb7cb3d7479d60398 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.713909:0:6582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000157031f9/0xb7cb3d7479d60398 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.713919:0:6582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000157031f9/0xb7cb3d7479d60398 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.713941:0:6582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000157031f9/0xb7cb3d7479d60398 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.713950:0:6582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101774800 already unused, calling callback (ffffffffc1784220) 00010000:00010000:0.0:1789081699.713955:0:6582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000157031f9/0xb7cb3d7479d60398 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.713965:0:6582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000157031f9/0xb7cb3d7479d60398 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.713979:0:6582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000157031f9/0xb7cb3d7479d60398 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.713988:0:6582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000157031f9/0xb7cb3d7479d60398 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081699.714049:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41476931-e751-413e-b98c-64d4d0edcd05+7:2350:x1875987796147968:12345-192.168.201.17@tcp:1:lhsmtool_posix.0 Request processed in 10295us (10654us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081699.714059:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 57 00000100:00100000:3.0:1789081699.724572:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081699.725043:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796148352 00000100:00100000:2.0:1789081699.725060:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796148352 00000100:00100000:2.0:1789081699.725160:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 186 00000100:00100000:2.0:1789081699.725171:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+17:11504:x1875987796148352:12345-192.168.201.17@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789081699.725286:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d6039f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.725308:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d6039f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.725322:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d6039f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.725636:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d603a6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.725649:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60360 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab05 expref: 18 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.725659:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d603a6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.725704:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60360 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab05 expref: 18 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081699.725719:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60360 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab05 expref: 18 pid: 9245 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081699.725734:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9486680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5790:1875987821306880:192.168.201.17@tcp:104: 00000100:00100000:2.0:1789081699.725862:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0fc2a36d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789081699.737797:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081699.737834:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796148480 00000100:00100000:3.0:1789081699.737845:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796148480 00010000:00010000:3.0:1789081699.737968:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60360 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab05 expref: 19 pid: 9245 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081699.738010:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 72 00000100:00100000:3.0:1789081699.738020:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41476931-e751-413e-b98c-64d4d0edcd05+19:2350:x1875987796148480:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789081699.738039:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081699.738048:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60360 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab05 expref: 19 pid: 9245 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.738063:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60360 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab05 expref: 19 pid: 9245 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.738090:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e10c7ecfa00) 00010000:00010000:3.0:1789081699.738104:0:5774:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d603a6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.738116:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d603a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.738125:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d603a6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.738148:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789081699.738207:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41476931-e751-413e-b98c-64d4d0edcd05+19:2350:x1875987796148480:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 189us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081699.738214:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 72 00010000:00010000:3.0:1789081699.738342:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60360 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab05 expref: 18 pid: 9245 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081699.738361:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9486680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5790:1875987821306880:192.168.201.17@tcp:104: 00010000:00010000:3.0:1789081699.738438:0:5790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d603a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.738449:0:5790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d603a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.738456:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d603a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789081699.738737:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1789081699.738905:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1789081699.738943:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1789081699.739031:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101ad0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5790:1875987821307008:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789081699.739106:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081699.739143:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d12f3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789081699.743976:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821307008 00000100:00100000:1.0:1789081699.743997:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821307008 00000100:00100000:1.0:1789081699.744099:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789081699.744113:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5790:x1875987821307008:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789081699.744297:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5790:x1875987821307008:12345-0@lo:1000:mdt00_001.0 Request processed in 187us (5189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081699.744305:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789081699.744365:0:5790:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1789081699.744373:0:5790:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e10c8a1ca80, transno 4294967315 00000100:00100000:1.0:1789081699.744391:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101ad0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5790:1875987821307008:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1789081699.745059:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:1.0:1789081699.745185:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d0ef1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5790:1875987821307136:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789081699.745257:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081699.745293:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10f95bcb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789081699.745520:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821307136 00000100:00100000:1.0:1789081699.745552:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821307136 00000100:00100000:1.0:1789081699.745589:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789081699.745598:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101ad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5790:x1875987821307136:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789081699.745805:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101ad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5790:x1875987821307136:12345-0@lo:1000:mdt00_001.0 Request processed in 207us (546us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1789081699.745814:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789081699.745867:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d0ef1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5790:1875987821307136:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1789081699.745924:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d603a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.745936:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d603a6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.745944:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d603a6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.745951:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101774000 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081699.745956:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d603a6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.745964:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d603a6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.745984:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e10c7ecfa00) 00010000:00010000:1.0:1789081699.745987:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789081699.745993:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d603a6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.745999:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d603a6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.746035:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d602db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.746041:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d602db lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.746046:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d602db lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.746058:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101982e00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081699.746061:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d602db lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.746066:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d602db lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.746075:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d19d3600) 00010000:00010000:1.0:1789081699.746077:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789081699.746080:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d602db lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.746086:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d602db lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.746113:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d603ad lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.746130:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d602f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aae9 expref: 21 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.746141:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d603ad lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.746173:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d602f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aae9 expref: 21 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081699.746190:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d602f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aae9 expref: 21 pid: 9245 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081699.746218:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c8a1ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5790:1875987821307264:192.168.201.17@tcp:104: 00000100:00100000:1.0:1789081699.746305:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c6682a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789081699.755557:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081699.755911:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c8a1ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5790:1875987821307264:192.168.201.17@tcp:104: 00010000:00010000:0.0:1789081699.755965:0:5790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d603ad lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081699.756737:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796148608 00000100:00100000:0.0:1789081699.756751:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796148608 00010000:00010000:0.0:1789081699.756819:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d602f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aae9 expref: 22 pid: 9245 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081699.756870:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 73 00000100:00100000:0.0:1789081699.756881:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41476931-e751-413e-b98c-64d4d0edcd05+22:2351:x1875987796148608:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789081699.756901:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789081699.756909:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d602f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aae9 expref: 22 pid: 9245 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.756923:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d602f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aae9 expref: 22 pid: 9245 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.756950:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d602f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aae9 expref: 22 pid: 9245 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.756972:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d19d3600) 00010000:00010000:0.0:1789081699.756980:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d603ad lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.756991:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d603ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.757000:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d603ad lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.757031:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789081699.757098:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41476931-e751-413e-b98c-64d4d0edcd05+21:2351:x1875987796148608:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 219us (1578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081699.757107:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 73 00010000:00010000:0.0:1789081699.757142:0:5790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d603ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.757151:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d603ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.757165:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d603ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.757173:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d603ad lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.757180:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d603ad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.757186:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13aec00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081699.757192:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d603ad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.757201:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d603ad lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.757210:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d19d3600) 00010000:00010000:0.0:1789081699.757213:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081699.757216:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d603ad lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.757222:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d603ad lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.757233:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d6039f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.757250:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d6039f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.757256:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d6039f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.757261:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101774a00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081699.757264:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d6039f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.757270:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d6039f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.757279:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d19d3600) 00010000:00010000:0.0:1789081699.757281:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789081699.757284:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d6039f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.757290:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774a00/0xb7cb3d7479d6039f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081699.757597:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+20:11504:x1875987796148352:12345-192.168.201.17@tcp:57:lhsmtool_posix.0 Request processed in 32427us (33032us total) trans 4294967467 rc 0/0 00000100:00100000:0.0:1789081699.757607:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 186 00000020:00080000:0.0:1789081699.757610:0:5790:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789081699.757958:0:11539:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789081699.757964:0:11539:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789081699.758611:0:11539:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1789081699.758726:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789081699.767779:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081699.767964:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796148864 00000100:00100000:3.0:1789081699.767978:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796148864 00000100:00100000:3.0:1789081699.768052:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 50 00000100:00100000:3.0:1789081699.768064:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b65450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+20:11504:x1875987796148864:12345-192.168.201.17@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789081699.768991:0:5793:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789081699.769119:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:3.0:1789081699.769193:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d603b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.769215:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d603b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.769229:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d603b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.769239:0:5793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d603b4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.769245:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d603b4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.769252:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d603b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081699.769277:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789081699.769420:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b65450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+22:11504:x1875987796148864:12345-192.168.201.17@tcp:35:lhsmtool_posix.0 Request processed in 1354us (1652us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1789081699.769442:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 50 00000020:00080000:3.0:1789081699.769450:0:5793:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789081699.770187:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789081699.770200:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d603b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.770210:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999600 already unused, calling callback (ffffffffc1784220) 00010000:00010000:0.0:1789081699.770238:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d603b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.770249:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d603b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.770269:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e10d046fe00) 00010000:00010000:0.0:1789081699.770272:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789081699.770277:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d603b4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.770283:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d603b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081699.770307:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081699.770308:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081699.770310:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789081699.939490:0:12308:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789081699.939504:0:12308:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789081699.939856:0:12308:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1789081699.939865:0:12308:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789081700.126690:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081700.198338:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081700.199744:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796149120 00000100:00100000:0.0:1789081700.199769:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796149120 00000100:00100000:0.0:1789081700.199890:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 187 00000100:00100000:0.0:1789081700.199905:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+22:11514:x1875987796149120:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:0.0:1789081700.199937:0:7252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081700.199969:0:7252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d603bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ab21 expref: -99 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.200895:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d603c2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.200917:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d603c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.200948:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d603c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789081700.200966:0:7252:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1789081700.201378:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d603bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab21 expref: 25 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.201403:0:7252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d603c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab21 expref: 24 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.201414:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e10c7ecf100) 00010000:00010000:0.0:1789081700.201417:0:7252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789081700.201422:0:7252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101982000, rc 0) 00000100:00100000:0.0:1789081700.201548:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+24:11514:x1875987796149120:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 1623us (3203us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1789081700.201558:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 187 00000100:00080000:0.0:1789081700.201600:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789081700.214463:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081700.214505:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796149248 00000100:00100000:3.0:1789081700.214518:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796149248 00000100:00100000:3.0:1789081700.214602:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 188 00000100:00100000:3.0:1789081700.214626:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+24:11514:x1875987796149248:12345-192.168.201.17@tcp:34:lfs.0 00010000:00010000:3.0:1789081700.214726:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d603d0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.214749:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d603d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.214762:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d603d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.214777:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d603d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.214785:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d603d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.214791:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d603d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.218619:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d603de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.218647:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d603de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.218665:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d603de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789081700.218746:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d603de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.218769:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d603d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.218779:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d603d0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.218786:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d603d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.218794:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998200 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081700.218800:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d603d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.218809:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d603d0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.218828:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e10c7ecf100) 00010000:00010000:3.0:1789081700.218831:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081700.218838:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d603d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.218858:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d603d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.218876:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d603d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.218883:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d603d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.218890:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d603d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.218895:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998000 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081700.218899:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d603d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.218905:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d603d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.218914:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e10d046f400) 00010000:00010000:3.0:1789081700.218917:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081700.218920:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d603d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.218926:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d603d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.218943:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d603de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.218949:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d603de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.218963:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d603de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.218967:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998e00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081700.218971:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d603de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.218978:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d603de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.218987:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d046f000) 00010000:00010000:3.0:1789081700.218990:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081700.218993:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d603de lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.218999:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d603de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081700.219155:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+24:11514:x1875987796149248:12345-192.168.201.17@tcp:34:lfs.0 Request processed in 4524us (4698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081700.219171:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 188 00000001:00080000:3.0:1789081700.303122:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:3.0:1789081700.303158:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:2.0:1789081700.308389:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081700.308576:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796149504 00000100:00100000:0.0:1789081700.308590:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796149504 00000100:00100000:3.0:1789081700.309056:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 189 00000100:00100000:3.0:1789081700.309071:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+24:11517:x1875987796149504:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:3.0:1789081700.309101:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081700.309132:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d603e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ab28 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.309273:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d603ec lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.309293:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d603ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.309307:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d603ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.309325:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d603f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.309333:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d603f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.309340:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d603f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.309806:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d603fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.309816:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d603fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.309823:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d603fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789081700.309833:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789081700.309947:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d603ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.309955:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d603ec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.309968:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d603ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.309975:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998e00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081700.309980:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d603ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.309988:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d603ec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.310002:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e10c7ecf100) 00010000:00010000:3.0:1789081700.310006:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081700.310011:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d603ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.310018:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998e00/0xb7cb3d7479d603ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.310033:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d603f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.310039:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d603f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.310045:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d603f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.310049:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998000 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081700.310052:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d603f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.310069:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d603f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.310078:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e10d046f000) 00010000:00010000:3.0:1789081700.310081:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081700.310084:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d603f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.310090:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d603f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.310138:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d603e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab28 expref: 27 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.310152:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d603fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab28 expref: 26 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.310160:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d046f400) 00010000:00010000:3.0:1789081700.310162:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789081700.310164:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101998200, rc 0) 00000100:00100000:3.0:1789081700.310258:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+26:11517:x1875987796149504:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 1191us (1883us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1789081700.310268:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 189 00000100:00100000:3.0:1789081700.314463:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081700.319757:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796149632 00000100:00100000:0.0:1789081700.319780:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796149632 00000100:00100000:0.0:1789081700.319945:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 190 00000100:00100000:0.0:1789081700.319961:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+26:11517:x1875987796149632:12345-192.168.201.17@tcp:54:lfs.0 00010000:00010000:0.0:1789081700.320063:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d60408 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.320086:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d60408 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.320125:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d60408 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.320164:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d60408 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.320172:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d60408 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.320180:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d60408 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.320187:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101983600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081700.320192:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d60408 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.320201:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d60408 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.320215:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d046f400) 00010000:00010000:0.0:1789081700.320218:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789081700.320224:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d60408 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.320232:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d60408 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081700.320359:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+26:11517:x1875987796149632:12345-192.168.201.17@tcp:54:lfs.0 Request processed in 401us (5909us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081700.320368:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 190 00000100:00100000:0.0:1789081700.325180:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081700.325296:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796149888 00000100:00100000:3.0:1789081700.325311:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796149888 00000100:00100000:3.0:1789081700.325387:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 51 00000100:00100000:3.0:1789081700.325400:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+26:11517:x1875987796149888:12345-192.168.201.17@tcp:35:lfs.0 00000100:00100000:3.0:1789081700.325830:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+27:11517:x1875987796149888:12345-192.168.201.17@tcp:35:lfs.0 Request processed in 432us (665us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1789081700.325840:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 51 00000100:00100000:2.0:1789081700.370577:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081700.370653:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796150144 00000100:00100000:3.0:1789081700.370668:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796150144 00000100:00100000:3.0:1789081700.370749:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 191 00000100:00100000:3.0:1789081700.370761:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+27:11052:x1875987796150144:12345-192.168.201.17@tcp:101:bash.0 00010000:00010000:3.0:1789081700.370800:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081700.370833:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d6040f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ab2f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.370973:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60416 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.370993:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d603fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab28 expref: 28 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.371006:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60416 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.371144:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d603fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab28 expref: 28 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.371163:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d603fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab28 expref: 28 pid: 5790 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081700.371182:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c50baa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5791:1875987821307392:192.168.201.17@tcp:104: 00000100:00100000:3.0:1789081700.371837:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d0c9ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1789081700.376893:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c50baa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5791:1875987821307392:192.168.201.17@tcp:104: 00010000:00010000:3.0:1789081700.376934:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60416 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081700.377043:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081700.377200:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796150272 00000100:00100000:3.0:1789081700.377209:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796150272 00010000:00010000:3.0:1789081700.377274:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d603fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab28 expref: 29 pid: 5790 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081700.377326:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 74 00000100:00100000:3.0:1789081700.377337:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41476931-e751-413e-b98c-64d4d0edcd05+29:2351:x1875987796150272:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789081700.377356:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081700.377364:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d603fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab28 expref: 29 pid: 5790 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.377377:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d603fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab28 expref: 29 pid: 5790 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.377657:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d603fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab28 expref: 29 pid: 5790 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.377679:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d046f400) 00010000:00010000:3.0:1789081700.377684:0:5774:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60416 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.377695:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60416 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.377725:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60416 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.377760:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789081700.377827:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41476931-e751-413e-b98c-64d4d0edcd05+28:2351:x1875987796150272:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 492us (1817us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081700.377835:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 74 00010000:00010000:0.0:1789081700.377962:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60416 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.377970:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60416 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789081700.377993:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1789081700.378184:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d6040f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab2f expref: 29 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.378202:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60416 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab2f expref: 28 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.378210:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d046f400) 00010000:00010000:0.0:1789081700.378213:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789081700.378216:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101998000, rc 0) 00000100:00100000:0.0:1789081700.378674:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+28:11052:x1875987796150144:12345-192.168.201.17@tcp:101:bash.0 Request processed in 7915us (8162us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1789081700.378682:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 191 00000100:00100000:0.0:1789081700.384097:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081700.384252:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796150528 00000100:00100000:3.0:1789081700.384265:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796150528 00000100:00100000:3.0:1789081700.384349:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 192 00000100:00100000:3.0:1789081700.384362:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5ddb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+28:11052:x1875987796150528:12345-192.168.201.17@tcp:36:bash.0 00010000:00010000:3.0:1789081700.384972:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d60424 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.384996:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d60424 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.385011:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d60424 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789081700.385084:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:3.0:1789081700.385114:0:5790:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d27994e0 reply state 000000006bdf50a0 transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d60424 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081700.385125:0:5790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789081700.385174:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:3.0:1789081700.385932:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5ddb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+32:11052:x1875987796150528:12345-192.168.201.17@tcp:36:bash.0 Request processed in 1566us (1842us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1789081700.385942:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 192 00000020:00080000:3.0:1789081700.385968:0:5790:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1789081700.390734:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d60424 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.390757:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d60424 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.390766:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d60424 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.390773:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998200 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081700.390779:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d60424 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.390788:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d60424 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.390811:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d046f400) 00010000:00010000:3.0:1789081700.390815:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081700.390821:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d60424 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.390828:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d60424 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081700.391291:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081700.391859:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796150656 00000100:00100000:1.0:1789081700.391875:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796150656 00000100:00100000:1.0:1789081700.392009:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 193 00000100:00100000:1.0:1789081700.392031:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5dd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+31:11052:x1875987796150656:12345-192.168.201.17@tcp:101:bash.0 00010000:00010000:1.0:1789081700.392065:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081700.392093:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d6042b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ab36 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.392174:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d6042b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab36 expref: 32 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.392191:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d6042b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab36 expref: 32 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.392214:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d046f400) 00010000:00010000:1.0:1789081700.392230:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789081700.392234:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13aee00, rc 0) 00000100:00100000:1.0:1789081700.392322:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5dd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+32:11052:x1875987796150656:12345-192.168.201.17@tcp:101:bash.0 Request processed in 302us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081700.392330:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 193 00000100:00100000:3.0:1789081700.395629:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081700.395685:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796150784 00000100:00100000:3.0:1789081700.395699:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796150784 00000100:00100000:3.0:1789081700.395770:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 58 00000100:00100000:3.0:1789081700.395783:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41476931-e751-413e-b98c-64d4d0edcd05+7:11052:x1875987796150784:12345-192.168.201.17@tcp:101:bash.0 00010000:00010000:3.0:1789081700.395809:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081700.395839:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fac1aed6/0xb7cb3d7479d60432 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ab3d expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789081700.395892:0:6581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa33862, atime: 0x6aa33861, ctime: 0x6aa33862, blocks: 0xb 00010000:00010000:3.0:1789081700.395927:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=367s v=(0 0) 00010000:00010000:3.0:1789081700.395932:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081700.395944:0:6581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fac1aed6/0xb7cb3d7479d60432 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab3d expref: 8 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.395963:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fac1aed6/0xb7cb3d7479d60432 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab3d expref: 8 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.395978:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101998e00, rc 0) 00000100:00100000:3.0:1789081700.396206:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41476931-e751-413e-b98c-64d4d0edcd05+8:11052:x1875987796150784:12345-192.168.201.17@tcp:101:bash.0 Request processed in 424us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081700.396215:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 58 00000100:00100000:0.0:1789081700.399864:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081700.400039:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796150912 00000100:00100000:1.0:1789081700.400052:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796150912 00002000:00010000:1.0:1789081700.400110:0:6587:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1789081700.400116:0:6587:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e10f5ddb100 with x1875987796150912 ext(0->18446744073709551615) 00002000:00010000:1.0:1789081700.400131:0:6587:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e10f5ddb100. 00000100:00100000:1.0:1789081700.400171:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 5 00000100:00100000:1.0:1789081700.400182:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41476931-e751-413e-b98c-64d4d0edcd05+8:2350:x1875987796150912:12345-192.168.201.17@tcp:10:bash.0 00002000:00010000:1.0:1789081700.400616:0:6587:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1789081700.400621:0:6587:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789081698 -> 1789081700 00002000:00010000:1.0:1789081700.400624:0:6587:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1789081697 -> 1789081697 00002000:00010000:1.0:1789081700.400626:0:6587:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789081698 -> 1789081700 00002000:00010000:1.0:1789081700.400628:0:6587:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1789081700.400703:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41476931-e751-413e-b98c-64d4d0edcd05+9:2350:x1875987796150912:12345-192.168.201.17@tcp:10:bash.0 Request processed in 521us (856us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1789081700.400712:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 5 00002000:00010000:1.0:1789081700.400716:0:6587:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1789081700.400719:0:6587:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e10f5ddb100 with x1875987796150912 ext(0->18446744073709551615) 00002000:00010000:1.0:1789081700.400724:0:6587:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e10f5ddb100. 00000100:00100000:0.0:1789081700.496508:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081700.496870:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796151040 00000100:00100000:3.0:1789081700.496886:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796151040 00000100:00100000:3.0:1789081700.497038:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 194 00000100:00100000:3.0:1789081700.497053:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5dda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+32:11531:x1875987796151040:12345-192.168.201.17@tcp:34:lfs.0 00010000:00010000:3.0:1789081700.497171:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d60439 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.497196:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d60439 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.497214:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d60439 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.497276:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60440 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.497285:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60440 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.497293:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60440 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.497904:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d60447 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.497918:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d60447 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.497928:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d60447 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789081700.497989:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d60447 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.498004:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d60439 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.498012:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d60439 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.498161:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d60439 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.498170:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998200 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081700.498176:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d60439 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.498196:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d60439 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.498214:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e10c7ecf100) 00010000:00010000:3.0:1789081700.498217:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081700.498263:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d60439 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.498272:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d60439 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.498291:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60440 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.498298:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60440 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.498305:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60440 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.498311:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999e00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081700.498314:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60440 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.498322:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60440 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.498330:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e10d046ff00) 00010000:00010000:3.0:1789081700.498333:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081700.498336:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60440 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.498356:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d60440 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.498376:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d60447 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.498383:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d60447 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.498389:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d60447 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.498394:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999000 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081700.498398:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d60447 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.498748:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d60447 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.498760:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d046f400) 00010000:00010000:3.0:1789081700.498763:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081700.498767:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d60447 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.498773:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d60447 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081700.498909:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5dda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+32:11531:x1875987796151040:12345-192.168.201.17@tcp:34:lfs.0 Request processed in 1854us (2411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081700.498921:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 194 00000100:00100000:3.0:1789081700.576051:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081700.578873:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796151296 00000100:00100000:0.0:1789081700.578895:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796151296 00000100:00100000:0.0:1789081700.579022:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 195 00000100:00100000:0.0:1789081700.579035:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+32:11534:x1875987796151296:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:0.0:1789081700.579067:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081700.579137:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d6044e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ab44 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.579256:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d60455 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.579279:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d60455 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.579294:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d60455 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.579320:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d6045c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.579328:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d6045c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.579336:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d6045c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.579907:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d60463 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.579921:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d60463 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.579929:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d60463 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789081700.579943:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789081700.580089:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d60455 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.580109:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d60455 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.580116:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d60455 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.580122:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101983c00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081700.580127:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d60455 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.580136:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d60455 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.580151:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e10c7ecf100) 00010000:00010000:0.0:1789081700.580155:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081700.580161:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d60455 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.580169:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d60455 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.580184:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d6045c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.580190:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d6045c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.580196:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d6045c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.580200:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101983400 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081700.580210:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d6045c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.580216:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d6045c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.580224:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e10d19d3000) 00010000:00010000:0.0:1789081700.580227:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081700.580231:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d6045c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.580237:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d6045c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.580306:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d6044e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab44 expref: 35 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.580325:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d60463 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab44 expref: 34 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.580332:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d046f400) 00010000:00010000:0.0:1789081700.580335:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789081700.580338:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101983000, rc 0) 00000100:00100000:0.0:1789081700.580502:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+34:11534:x1875987796151296:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 1465us (4465us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1789081700.580513:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 195 00000100:00100000:2.0:1789081700.598119:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081700.598263:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796151424 00000100:00100000:1.0:1789081700.598277:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796151424 00000100:00100000:1.0:1789081700.598404:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 196 00000100:00100000:1.0:1789081700.598417:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+34:11534:x1875987796151424:12345-192.168.201.17@tcp:54:lfs.0 00010000:00010000:1.0:1789081700.598511:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d60471 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.598574:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60416 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab2f expref: 34 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.598620:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d60471 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.598669:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60416 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab2f expref: 34 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.598684:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60416 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab2f expref: 34 pid: 5791 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081700.598702:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c8a1ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5789:1875987821307520:192.168.201.17@tcp:104: 00000100:00100000:1.0:1789081700.598844:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c539f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789081700.602781:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c8a1ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5789:1875987821307520:192.168.201.17@tcp:104: 00010000:00010000:0.0:1789081700.602827:0:5789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d60471 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081700.604647:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081700.604942:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796151680 00000100:00100000:0.0:1789081700.604956:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796151680 00000100:00100000:0.0:1789081700.605041:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 52 00000100:00100000:0.0:1789081700.605053:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+35:5566:x1875987796151680:12345-192.168.201.17@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789081700.607663:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+36:5566:x1875987796151680:12345-192.168.201.17@tcp:35:ldlm_bl.0 Request processed in 2594us (3010us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1789081700.607680:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 52 00000100:00100000:1.0:1789081700.610123:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081700.610298:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796151808 00000100:00100000:0.0:1789081700.610310:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796151808 00010000:00010000:0.0:1789081700.610449:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60416 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab2f expref: 36 pid: 5791 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081700.610495:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 75 00000100:00100000:0.0:1789081700.610508:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c9389c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41476931-e751-413e-b98c-64d4d0edcd05+36:2351:x1875987796151808:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789081700.610564:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789081700.610572:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60416 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab2f expref: 36 pid: 5791 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.610584:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60416 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab2f expref: 36 pid: 5791 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.610622:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d60416 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab2f expref: 36 pid: 5791 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.610648:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d046f400) 00010000:00010000:0.0:1789081700.610669:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d60471 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.610681:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d60471 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.610691:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d60471 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.610723:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789081700.610909:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c9389c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41476931-e751-413e-b98c-64d4d0edcd05+35:2351:x1875987796151808:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 394us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081700.610918:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 75 00010000:00010000:1.0:1789081700.611040:0:5789:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d60471 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.611049:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d60471 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.611091:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d60471 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.611100:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d60471 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.611107:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d60471 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.611114:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13aec00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081700.611120:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d60471 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.611136:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d60471 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.611147:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d046f400) 00010000:00010000:1.0:1789081700.611150:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789081700.611155:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d60471 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.611162:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d60471 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081700.611226:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+34:11534:x1875987796151424:12345-192.168.201.17@tcp:54:lfs.0 Request processed in 12801us (13110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081700.611236:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 196 00000100:00100000:2.0:1789081700.613882:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081700.614026:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796152064 00000100:00100000:3.0:1789081700.614041:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796152064 00000100:00100000:3.0:1789081700.614112:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 53 00000100:00100000:3.0:1789081700.614124:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+34:11534:x1875987796152064:12345-192.168.201.17@tcp:35:lfs.0 00000100:00100000:3.0:1789081700.614828:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+35:11534:x1875987796152064:12345-192.168.201.17@tcp:35:lfs.0 Request processed in 703us (955us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1789081700.614838:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 53 00000100:00100000:2.0:1789081700.713502:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081700.713752:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796152320 00000100:00100000:3.0:1789081700.713766:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796152320 00000100:00100000:3.0:1789081700.713854:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 197 00000100:00100000:3.0:1789081700.713867:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+35:11545:x1875987796152320:12345-192.168.201.17@tcp:101:cat.0 00010000:00010000:3.0:1789081700.713900:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081700.714081:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d60478 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ab4b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.714186:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d6047f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.714205:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d6047f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.714219:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d6047f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.714236:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d60486 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.714244:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d60486 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.714271:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d60486 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.714911:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d6048d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.714922:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d6048d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.714930:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d6048d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789081700.715090:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1789081700.715224:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d6047f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.715233:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d6047f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.715239:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d6047f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.715246:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999e00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081700.715251:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d6047f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.715259:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d6047f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.715323:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e10c7ecf100) 00010000:00010000:3.0:1789081700.715326:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081700.715340:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d6047f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.715348:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d6047f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.715363:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d60486 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.715370:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d60486 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.715375:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d60486 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.715381:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998200 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081700.715383:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d60486 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.715389:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d60486 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.715397:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e10d046ff00) 00010000:00010000:3.0:1789081700.715659:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081700.715664:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d60486 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.715671:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998200/0xb7cb3d7479d60486 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.715736:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d60478 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab4b expref: 38 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.715765:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d6048d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab4b expref: 37 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.715772:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d046f400) 00010000:00010000:3.0:1789081700.715774:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789081700.715778:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101998800, rc 0) 00000100:00100000:3.0:1789081700.715875:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+37:11545:x1875987796152320:12345-192.168.201.17@tcp:101:cat.0 Request processed in 2010us (2387us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1789081700.715886:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 197 00000100:00100000:1.0:1789081700.720436:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081700.720773:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796152576 00000100:00100000:0.0:1789081700.720786:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796152576 00000100:00100000:0.0:1789081700.720848:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 54 00000100:00100000:0.0:1789081700.720857:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c8a1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+37:11545:x1875987796152576:12345-192.168.201.17@tcp:35:cat.0 00000100:00100000:0.0:1789081700.721815:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c8a1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+38:11545:x1875987796152576:12345-192.168.201.17@tcp:35:cat.0 Request processed in 952us (1386us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1789081700.721827:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 54 00000100:00100000:2.0:1789081700.755105:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081700.759174:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796152832 00000100:00100000:0.0:1789081700.759196:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796152832 00000100:00100000:1.0:1789081700.765199:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 198 00000100:00100000:1.0:1789081700.765218:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+38:11546:x1875987796152832:12345-192.168.201.17@tcp:36:rm.0 00010000:00010000:1.0:1789081700.765671:0:7252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789081700.765711:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d6048d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab4b expref: 38 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.765741:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d60463 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab44 expref: 37 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.765755:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d6042b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab36 expref: 36 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.765794:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10d046f400) 00010000:00010000:1.0:1789081700.765808:0:7252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789081700.765838:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d6049b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.765854:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d6049b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.765865:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d6049b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.765883:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d604a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.765891:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d604a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.765910:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d604a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.768699:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d604a9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.768725:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d604a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.768741:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d604a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789081700.772205:0:7252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:1.0:1789081700.772224:0:7252:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 367654699072ns, next at 368654694744ns, rc = 0 00010000:00010000:1.0:1789081700.776138:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1400/0xb7cb3d7479d604b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.776174:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1400/0xb7cb3d7479d604b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.776195:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1400/0xb7cb3d7479d604b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.776206:0:7252:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1400/0xb7cb3d7479d604b0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.776213:0:7252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1400/0xb7cb3d7479d604b0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.776219:0:7252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1400/0xb7cb3d7479d604b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.776254:0:7252:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789081700.776425:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789081700.776436:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1400/0xb7cb3d7479d604b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.776444:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10d1bd1400 already unused, calling callback (ffffffffc1784220) 00010000:00010000:0.0:1789081700.776449:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1400/0xb7cb3d7479d604b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.776484:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1400/0xb7cb3d7479d604b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.776501:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10c7ecfa00) 00010000:00010000:0.0:1789081700.776504:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789081700.776511:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1400/0xb7cb3d7479d604b0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.776518:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1400/0xb7cb3d7479d604b0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.776582:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081700.776584:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081700.776586:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081700.776725:0:7252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d604a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.776733:0:7252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d604a9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.776740:0:7252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d604a9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.776745:0:7252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13afe00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081700.776749:0:7252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d604a9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.776756:0:7252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d604a9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.776773:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e10c7ecfa00) 00010000:00010000:1.0:1789081700.776775:0:7252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789081700.776779:0:7252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d604a9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.776785:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afe00/0xb7cb3d7479d604a9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.776813:0:7252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d6049b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.776819:0:7252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d6049b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.776825:0:7252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d6049b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.776831:0:7252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13aec00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081700.776833:0:7252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d6049b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.776839:0:7252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d6049b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.776846:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e10c7ecf100) 00010000:00010000:1.0:1789081700.776848:0:7252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789081700.776850:0:7252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d6049b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.776856:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aec00/0xb7cb3d7479d6049b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789081700.776876:0:7252:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000694d5bfc reply state 00000000a13d4fec transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d604a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081700.776886:0:7252:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789081700.777686:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+37:11546:x1875987796152832:12345-192.168.201.17@tcp:36:rm.0 Request processed in 12461us (22584us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1789081700.777698:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 198 00010000:00010000:0.0:1789081700.781725:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d604a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.781750:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d604a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.781758:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d604a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.781765:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13af600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081700.781771:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d604a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.781779:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d604a2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.781800:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e10c7ecfc00) 00010000:00010000:0.0:1789081700.781821:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081700.781827:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d604a2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081700.781834:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af600/0xb7cb3d7479d604a2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081700.849244:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081700.849431:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796153088 00000100:00100000:1.0:1789081700.849451:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796153088 00000100:00100000:1.0:1789081700.849662:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 199 00000100:00100000:1.0:1789081700.849681:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff702a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+36:11552:x1875987796153088:12345-192.168.201.17@tcp:101:bash.0 00010000:00010000:1.0:1789081700.849726:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081700.849763:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1800/0xb7cb3d7479d604b7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ab52 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.849964:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0800/0xb7cb3d7479d604be lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.849991:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0800/0xb7cb3d7479d604be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.850010:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0800/0xb7cb3d7479d604be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.850028:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0200/0xb7cb3d7479d604c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.850036:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0200/0xb7cb3d7479d604c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.850065:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0200/0xb7cb3d7479d604c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789081700.851022:0:5789:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1789081700.851242:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0600/0xb7cb3d7479d604cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.851256:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0600/0xb7cb3d7479d604cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.851267:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0600/0xb7cb3d7479d604cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.851316:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0800/0xb7cb3d7479d604be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.851323:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0800/0xb7cb3d7479d604be lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.851330:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0800/0xb7cb3d7479d604be lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.851336:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10d1bd0800 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081700.851341:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0800/0xb7cb3d7479d604be lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.851348:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0800/0xb7cb3d7479d604be lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.851362:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e10c7ecf100) 00010000:00010000:1.0:1789081700.851366:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789081700.851379:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0800/0xb7cb3d7479d604be lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.851386:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0800/0xb7cb3d7479d604be lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789081700.851401:0:5789:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000070f5cb24 reply state 00000000041e4e7e transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0200/0xb7cb3d7479d604c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081700.851410:0:5789:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789081700.851452:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1800/0xb7cb3d7479d604b7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab52 expref: 39 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.851467:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0600/0xb7cb3d7479d604cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab52 expref: 38 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081700.851475:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e10c7ecf900) 00010000:00010000:1.0:1789081700.851477:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789081700.851480:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10d1bd0600, rc 0) 00000100:00100000:1.0:1789081700.851693:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff702a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+39:11552:x1875987796153088:12345-192.168.201.17@tcp:101:bash.0 Request processed in 2013us (2467us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1789081700.851709:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 199 00010000:00010000:3.0:1789081700.854211:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0200/0xb7cb3d7479d604c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.854235:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0200/0xb7cb3d7479d604c5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.854243:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0200/0xb7cb3d7479d604c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.854250:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10d1bd0200 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081700.854257:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0200/0xb7cb3d7479d604c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.854266:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0200/0xb7cb3d7479d604c5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.854292:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e10c7ecfa00) 00010000:00010000:3.0:1789081700.854297:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081700.854303:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0200/0xb7cb3d7479d604c5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.854337:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0200/0xb7cb3d7479d604c5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081700.863387:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081700.863560:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796153216 00000100:00100000:3.0:1789081700.863574:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796153216 00000100:00100000:3.0:1789081700.863715:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 59 00000100:00100000:3.0:1789081700.863728:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff700a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+5:2349:x1875987796153216:12345-192.168.201.17@tcp:101:bash.0 00010000:00010000:3.0:1789081700.863753:0:6584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081700.863783:0:6584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001cb618a/0xb7cb3d7479d604da lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ab59 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789081700.863825:0:6584:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789081700.863862:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=367s v=(0 0) 00010000:00010000:3.0:1789081700.863870:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081700.863888:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001cb618a/0xb7cb3d7479d604da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab59 expref: 6 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.863920:0:6584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000001cb618a/0xb7cb3d7479d604da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab59 expref: 6 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.863941:0:6584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101999000, rc 0) 00000100:00100000:3.0:1789081700.864073:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff700a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+6:2349:x1875987796153216:12345-192.168.201.17@tcp:101:bash.0 Request processed in 348us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081700.864081:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 59 00000100:00080000:0.0:1789081700.864200:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789081700.868807:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081700.868977:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796153344 00000100:00100000:3.0:1789081700.868993:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796153344 00000100:00100000:3.0:1789081700.869166:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 60 00000100:00100000:3.0:1789081700.869182:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff702300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41476931-e751-413e-b98c-64d4d0edcd05+6:11552:x1875987796153344:12345-192.168.201.17@tcp:101:bash.0 00010000:00010000:3.0:1789081700.869213:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081700.869241:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d604e1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ab60 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.869287:0:6581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000001cb618a/0xb7cb3d7479d604da lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab59 expref: 7 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.869301:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081700.869309:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081700.869318:0:6581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d604e1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab60 expref: 7 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.869371:0:6581:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000001cb618a/0xb7cb3d7479d604da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab59 expref: 7 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.869394:0:6581:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000001cb618a/0xb7cb3d7479d604da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab59 expref: 7 pid: 6584 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081700.869412:0:6581:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff645c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6581:1875987821307648:192.168.201.17@tcp:104: 00000100:00100000:3.0:1789081700.869645:0:6581:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d0c9e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789081700.879146:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081700.879326:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796153472 00000100:00100000:2.0:1789081700.879337:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796153472 00010000:00010000:2.0:1789081700.879390:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000001cb618a/0xb7cb3d7479d604da lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab59 expref: 8 pid: 6584 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081700.879519:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 76 00000100:00100000:2.0:1789081700.879569:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41476931-e751-413e-b98c-64d4d0edcd05+8:2350:x1875987796153472:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789081700.879590:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789081700.879634:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000001cb618a/0xb7cb3d7479d604da lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab59 expref: 8 pid: 6584 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081700.879892:0:6581:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff645c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6581:1875987821307648:192.168.201.17@tcp:104: 00010000:00010000:3.0:1789081700.879937:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d604e1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab60 expref: 8 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081700.879985:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101998200, rc 0) 00000100:00100000:3.0:1789081700.880071:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff702300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41476931-e751-413e-b98c-64d4d0edcd05+8:11552:x1875987796153344:12345-192.168.201.17@tcp:101:bash.0 Request processed in 10894us (11278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081700.880079:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 60 00010000:00010000:2.0:1789081700.880485:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000001cb618a/0xb7cb3d7479d604da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab59 expref: 7 pid: 6584 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081700.880522:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001cb618a/0xb7cb3d7479d604da lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab59 expref: 7 pid: 6584 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081700.880566:0:7481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789081700.880571:0:7481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789081700.880582:0:7481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d604e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab60 expref: 6 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081700.880605:0:7481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d604e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab60 expref: 6 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081700.880666:0:7481:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d604e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab60 expref: 6 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081700.880682:0:7481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff701c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7481:1875987821307776:192.168.201.17@tcp:105: 00000100:00100000:2.0:1789081700.880759:0:7481:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0fc2a36a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789081700.893407:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081700.895851:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796153728 00000100:00100000:3.0:1789081700.895874:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796153728 00000100:00100000:3.0:1789081700.895965:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 55 00000100:00100000:1.0:1789081700.896099:0:7481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff701c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7481:1875987821307776:192.168.201.17@tcp:105: 00010000:00010000:1.0:1789081700.896131:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789081700.896209:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41476931-e751-413e-b98c-64d4d0edcd05+6:2350:x1875987796153472:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 16643us (17079us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081700.896220:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 76 00000100:00100000:3.0:1789081700.896420:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+38:11552:x1875987796153728:12345-192.168.201.17@tcp:35:bash.0 00000100:00100000:3.0:1789081700.896887:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+39:11552:x1875987796153728:12345-192.168.201.17@tcp:35:bash.0 Request processed in 911us (3493us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1789081700.917165:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 55 00000100:00100000:2.0:1789081701.108303:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081701.110295:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796153856 00000100:00100000:3.0:1789081701.110309:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796153856 00000100:00100000:3.0:1789081701.110455:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 200 00000100:00100000:3.0:1789081701.110466:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+39:11568:x1875987796153856:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:3.0:1789081701.110492:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081701.110514:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d604e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ab67 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081701.110613:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d604ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081701.110629:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d604ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081701.110641:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d604ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789081701.110715:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1789081701.110719:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789081701.110743:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d604ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081701.110768:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d604e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab67 expref: 41 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081701.110787:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d604ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab67 expref: 40 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081701.110796:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e10c7ecf100) 00010000:00010000:3.0:1789081701.110799:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789081701.110802:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101999000, rc 0) 00000100:00100000:3.0:1789081701.112581:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+40:11568:x1875987796153856:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 1588us (3758us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081701.112601:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 200 00000100:00100000:1.0:1789081701.128202:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081701.128353:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796154112 00000100:00100000:2.0:1789081701.128363:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796154112 00000100:00100000:2.0:1789081701.128418:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 201 00000100:00100000:2.0:1789081701.128427:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+40:11568:x1875987796154112:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:2.0:1789081701.128449:0:7252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081701.128472:0:7252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d604f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ab6e expref: -99 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.129064:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d604fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.129088:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d604fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.129100:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d604fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789081701.129111:0:7252:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789081701.129234:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d604f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab6e expref: 43 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.129265:0:7252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d604fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab6e expref: 42 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.129273:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e10c7ecf900) 00010000:00010000:2.0:1789081701.129275:0:7252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789081701.129278:0:7252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101775000, rc 0) 00000100:00100000:2.0:1789081701.129343:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+42:11568:x1875987796154112:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 917us (1149us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1789081701.129350:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 201 00000100:00100000:2.0:1789081701.137757:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081701.137803:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081701.137953:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796154496 00000100:00100000:3.0:1789081701.137975:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796154496 00000100:00100000:3.0:1789081701.138298:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 15 00000100:00100000:3.0:1789081701.138310:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41476931-e751-413e-b98c-64d4d0edcd05+42:2350:x1875987796154496:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789081701.138334:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081701.138378:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d604fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab6e expref: 42 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081701.138670:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e10c7ecf900) 00010000:00010000:3.0:1789081701.138694:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789081701.138774:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41476931-e751-413e-b98c-64d4d0edcd05+41:2350:x1875987796154496:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 466us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081701.138783:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 15 00000100:00100000:0.0:1789081701.141832:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796154368 00000100:00100000:0.0:1789081701.141848:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796154368 00000100:00100000:0.0:1789081701.141932:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 202 00000100:00100000:0.0:1789081701.141944:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+41:11568:x1875987796154368:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:0.0:1789081701.141969:0:9245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081701.141993:0:9245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d6050b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ab75 expref: -99 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.142090:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d60512 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.142105:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d60512 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.142116:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d60512 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789081701.142129:0:9245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789081701.142258:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d6050b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab75 expref: 44 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.142281:0:9245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d60512 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab75 expref: 43 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.143265:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e10c7ecf900) 00010000:00010000:0.0:1789081701.143268:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789081701.143271:0:9245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101983c00, rc 0) 00000100:00100000:0.0:1789081701.143726:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+43:11568:x1875987796154368:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 1782us (5974us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1789081701.143736:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 202 00010000:00010000:0.0:1789081701.153717:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081701.154144:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081701.160627:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796154624 00000100:00100000:0.0:1789081701.160651:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796154624 00000100:00100000:0.0:1789081701.160829:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 61 00000100:00100000:0.0:1789081701.160847:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff645c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+6:2349:x1875987796154624:12345-192.168.201.17@tcp:1:lfs.0 00010000:00010000:1.0:1789081701.165256:0:6584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc32e516/0xb7cb3d7479d60520 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081701.165302:0:6584:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d604e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab60 expref: 6 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081701.165318:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789081701.165327:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789081701.165336:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc32e516/0xb7cb3d7479d60520 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081701.165432:0:6584:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d604e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab60 expref: 6 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081701.165463:0:6584:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d604e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab60 expref: 6 pid: 6581 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081701.165490:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101b14a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6584:1875987821307904:192.168.201.17@tcp:104: 00000100:00100000:1.0:1789081701.165797:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c539fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789081701.170207:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081701.170307:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796154752 00000100:00100000:0.0:1789081701.170317:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796154752 00002000:00100000:0.0:1789081701.170374:0:6588:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9e10f5f06a00 x1875987796154752/t0(0) o4->41476931-e751-413e-b98c-64d4d0edcd05@192.168.201.17@tcp:492/0 lens 504/0 e 0 to 0 dl 1789081712 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789081701.170386:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e10f5f06a00 with x1875987796154752 ext(0->8) 00010000:00010000:0.0:1789081701.170395:0:6588:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d604e1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab60 expref: 7 pid: 6581 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.170411:0:6588:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d604e1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab60 expref: 7 pid: 6581 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789081701.170419:0:6588:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9e10f5f06a00 00000100:00100000:0.0:1789081701.170460:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 3 00000100:00100000:0.0:1789081701.170471:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41476931-e751-413e-b98c-64d4d0edcd05+7:2351:x1875987796154752:12345-192.168.201.17@tcp:4:lfs.0 00000100:00100000:0.0:1789081701.170994:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:41476931-e751-413e-b98c-64d4d0edcd05+9:2351:x1875987796154752:12345-192.168.201.17@tcp:4:lfs.0 Request processed in 525us (796us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789081701.171000:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 3 00002000:00100000:0.0:1789081701.171005:0:6588:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9e10f5f06a00 x1875987796154752/t4294967308(0) o4->41476931-e751-413e-b98c-64d4d0edcd05@192.168.201.17@tcp:492/0 lens 504/448 e 0 to 0 dl 1789081712 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789081701.171011:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e10f5f06a00 with x1875987796154752 ext(0->8) 00010000:00010000:0.0:1789081701.171015:0:6588:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d604e1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab60 expref: 9 pid: 6581 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.171024:0:6588:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d604e1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab60 expref: 9 pid: 6581 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789081701.171029:0:6588:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9e10f5f06a00 00000100:00100000:1.0:1789081701.171809:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101b14a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6584:1875987821307904:192.168.201.17@tcp:104: 00010000:00010000:1.0:1789081701.171835:0:6584:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fc32e516/0xb7cb3d7479d60520 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081701.201014:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081701.201515:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796154880 00000100:00100000:0.0:1789081701.201564:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796154880 00010000:00010000:0.0:1789081701.201784:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d604e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab60 expref: 9 pid: 6581 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081701.202015:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 77 00000100:00100000:1.0:1789081701.202046:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41476931-e751-413e-b98c-64d4d0edcd05+9:2350:x1875987796154880:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789081701.202064:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789081701.202094:0:7481:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789081701.202097:0:7481:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789081700 00002000:00010000:1.0:1789081701.202099:0:7481:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789081701 00002000:00010000:1.0:1789081701.202102:0:7481:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789081700 00010000:00010000:1.0:1789081701.202109:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d604e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab60 expref: 9 pid: 6581 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081701.202123:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d604e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab60 expref: 9 pid: 6581 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081701.202145:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d604e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab60 expref: 9 pid: 6581 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081701.202162:0:7481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789081701.202167:0:7481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789081701.202174:0:7481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc32e516/0xb7cb3d7479d60520 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081701.202184:0:7481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc32e516/0xb7cb3d7479d60520 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081701.202236:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789081701.202294:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41476931-e751-413e-b98c-64d4d0edcd05+8:2350:x1875987796154880:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 269us (1291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081701.202301:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 77 00010000:00010000:3.0:1789081701.203431:0:6584:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fc32e516/0xb7cb3d7479d60520 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081701.203448:0:6584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc32e516/0xb7cb3d7479d60520 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081701.203477:0:6584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc32e516/0xb7cb3d7479d60520 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081701.203484:0:6584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc32e516/0xb7cb3d7479d60520 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081701.203502:0:6584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc32e516/0xb7cb3d7479d60520 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081701.203510:0:6584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10d1bd0c00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:3.0:1789081701.203514:0:6584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc32e516/0xb7cb3d7479d60520 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081701.203546:0:6584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc32e516/0xb7cb3d7479d60520 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081701.203579:0:6584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc32e516/0xb7cb3d7479d60520 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081701.203602:0:6584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc32e516/0xb7cb3d7479d60520 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081701.203735:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff645c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+7:2349:x1875987796154624:12345-192.168.201.17@tcp:1:lfs.0 Request processed in 42892us (49598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081701.203745:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 61 00000100:00100000:1.0:1789081701.212908:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789081701.212940:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5dd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821308032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789081701.213046:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081701.213216:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821308032 00000100:00100000:0.0:1789081701.213224:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821308032 00000100:00100000:0.0:1789081701.213287:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789081701.213297:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821308032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789081701.213319:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789081701.213388:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821308032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081701.213396:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789081701.213511:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000100:00080000:2.0:1789081701.213979:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1789081701.214222:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:3.0:1789081701.214269:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e10c8a1c700, transno 4294967307 00000100:00100000:3.0:1789081701.214360:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5dd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821308032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789081701.216741:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081701.216925:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796155136 00000100:00100000:1.0:1789081701.216942:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796155136 00000100:00100000:1.0:1789081701.217053:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 56 00000100:00100000:1.0:1789081701.217068:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b66c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+43:11568:x1875987796155136:12345-192.168.201.17@tcp:35:lfs.0 00000004:00010000:1.0:1789081701.217171:0:5792:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d60512 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab75 expref: 43 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789081701.217621:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1789081701.217731:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:1.0:1789081701.218218:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:1.0:1789081701.218282:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1c00/0xb7cb3d7479d60527 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081701.218301:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0600/0xb7cb3d7479d604cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab52 expref: 47 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081701.218313:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1c00/0xb7cb3d7479d60527 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081701.218370:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0600/0xb7cb3d7479d604cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab52 expref: 47 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081701.218395:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0600/0xb7cb3d7479d604cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab52 expref: 47 pid: 5789 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081701.218419:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff701c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5792:1875987821308160:192.168.201.17@tcp:104: 00000100:00100000:1.0:1789081701.218632:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c539fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789081701.228842:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff701c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5792:1875987821308160:192.168.201.17@tcp:104: 00010000:00010000:0.0:1789081701.228914:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1c00/0xb7cb3d7479d60527 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081701.230979:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081701.231635:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796155264 00000100:00100000:3.0:1789081701.231654:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796155264 00010000:00010000:3.0:1789081701.231729:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0600/0xb7cb3d7479d604cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab52 expref: 48 pid: 5789 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081701.231928:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 78 00000100:00100000:3.0:1789081701.231946:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41476931-e751-413e-b98c-64d4d0edcd05+48:2351:x1875987796155264:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789081701.231973:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081701.231986:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0600/0xb7cb3d7479d604cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab52 expref: 48 pid: 5789 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081701.234160:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0600/0xb7cb3d7479d604cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab52 expref: 48 pid: 5789 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081701.234240:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0600/0xb7cb3d7479d604cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab52 expref: 48 pid: 5789 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081701.234267:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e10c7ecf900) 00010000:00010000:3.0:1789081701.234272:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1c00/0xb7cb3d7479d60527 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081701.234283:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1c00/0xb7cb3d7479d60527 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081701.234291:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1c00/0xb7cb3d7479d60527 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081701.234329:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789081701.234462:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41476931-e751-413e-b98c-64d4d0edcd05+47:2351:x1875987796155264:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 2515us (3490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081701.234483:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 78 00010000:00010000:0.0:1789081701.236911:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1c00/0xb7cb3d7479d60527 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.236930:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1c00/0xb7cb3d7479d60527 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789081701.237129:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:0.0:1789081701.237393:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1789081701.237669:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5dd9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5792:1875987821308288:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789081701.237780:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081701.237832:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d0f9c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789081701.239345:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821308288 00000100:00100000:2.0:1789081701.239366:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821308288 00000100:00100000:2.0:1789081701.239477:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789081701.239490:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5dd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5792:x1875987821308288:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789081701.239763:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5dd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5792:x1875987821308288:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 272us (1980us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081701.239777:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789081701.240239:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5dd9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5792:1875987821308288:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789081701.244716:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1789081701.244905:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5792:1875987821308416:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789081701.245026:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081701.245094:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d106d480 going to sleep for 11 seconds 00000100:00100000:1.0:1789081701.246640:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821308416 00000100:00100000:1.0:1789081701.246661:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821308416 00000100:00100000:1.0:1789081701.246772:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789081701.246792:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5792:x1875987821308416:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789081701.247246:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5792:x1875987821308416:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 461us (2221us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789081701.247255:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789081701.249403:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5792:1875987821308416:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789081701.252141:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1789081701.252277:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1c00/0xb7cb3d7479d60527 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.252294:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1c00/0xb7cb3d7479d60527 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.252306:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1c00/0xb7cb3d7479d60527 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.252316:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10d1bd1c00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081701.252325:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1c00/0xb7cb3d7479d60527 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.252337:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1c00/0xb7cb3d7479d60527 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.252367:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e10c7ecf900) 00010000:00010000:2.0:1789081701.252372:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789081701.252380:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1c00/0xb7cb3d7479d60527 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.252423:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1c00/0xb7cb3d7479d60527 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789081701.252934:0:5792:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789081701.253099:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1789081701.253145:0:5792:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 368135619866ns, next at 369135614454ns, rc = 0 00000001:00080000:2.0:1789081701.253164:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1789081701.253232:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e10c7ecf900) 00010000:00010000:2.0:1789081701.253235:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789081701.253247:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d60512 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab75 expref: 51 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081701.253439:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b66c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+50:11568:x1875987796155136:12345-192.168.201.17@tcp:35:lfs.0 Request processed in 36369us (36707us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1789081701.253455:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 56 00000020:00080000:2.0:1789081701.253464:0:5792:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789081701.260773:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081701.261064:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796155392 00000100:00100000:3.0:1789081701.261077:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796155392 00000100:00100000:3.0:1789081701.261159:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 203 00000100:00100000:3.0:1789081701.261171:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+50:11568:x1875987796155392:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:3.0:1789081701.261212:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081701.261242:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d6052e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ab7c expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081701.261322:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d6052e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab7c expref: 51 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081701.261362:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d6052e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab7c expref: 51 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081701.261387:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e10d046ff00) 00010000:00010000:3.0:1789081701.261403:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789081701.261407:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101999e00, rc 0) 00000100:00100000:3.0:1789081701.261491:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+51:11568:x1875987796155392:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 321us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081701.261498:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 203 00000100:00100000:1.0:1789081701.265974:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081701.266273:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796155648 00000100:00100000:2.0:1789081701.266286:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796155648 00000100:00100000:2.0:1789081701.266364:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 57 00000100:00100000:2.0:1789081701.266376:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff701c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+51:11568:x1875987796155648:12345-192.168.201.17@tcp:35:lfs.0 00000100:00100000:2.0:1789081701.266841:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff701c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+52:11568:x1875987796155648:12345-192.168.201.17@tcp:35:lfs.0 Request processed in 464us (882us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1789081701.266877:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 57 00000100:00100000:2.0:1789081701.413977:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081701.414119:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796155776 00000100:00100000:1.0:1789081701.414132:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796155776 00000100:00100000:1.0:1789081701.414216:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 204 00000100:00100000:1.0:1789081701.414228:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+52:11579:x1875987796155776:12345-192.168.201.17@tcp:34:lfs.0 00010000:00010000:1.0:1789081701.414339:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1000/0xb7cb3d7479d60535 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081701.414366:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1000/0xb7cb3d7479d60535 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081701.414859:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1000/0xb7cb3d7479d60535 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.415162:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d6053c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.415172:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d6053c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.415181:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d6053c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.415315:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d60543 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.415324:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d60543 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.415331:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d60543 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789081701.415480:0:7252:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d60543 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.415504:0:7252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1000/0xb7cb3d7479d60535 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.415514:0:7252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1000/0xb7cb3d7479d60535 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.415564:0:7252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1000/0xb7cb3d7479d60535 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.415575:0:7252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10d1bd1000 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081701.415594:0:7252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1000/0xb7cb3d7479d60535 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.415608:0:7252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1000/0xb7cb3d7479d60535 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.415633:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e10c7ecf100) 00010000:00010000:0.0:1789081701.415639:0:7252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081701.415646:0:7252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1000/0xb7cb3d7479d60535 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.415657:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1000/0xb7cb3d7479d60535 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.415683:0:7252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d6053c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.415692:0:7252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d6053c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.415717:0:7252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d6053c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.415727:0:7252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101982600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081701.415734:0:7252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d6053c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.415745:0:7252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d6053c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.415763:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e10d19d3000) 00010000:00010000:0.0:1789081701.415768:0:7252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081701.415774:0:7252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d6053c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.415783:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d6053c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.415812:0:7252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d60543 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.415821:0:7252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d60543 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.415831:0:7252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d60543 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.415839:0:7252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101983600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081701.415842:0:7252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d60543 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.415859:0:7252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d60543 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.415867:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e10d046ff00) 00010000:00010000:0.0:1789081701.415870:0:7252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081701.415873:0:7252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d60543 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.415879:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d60543 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081701.416057:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+52:11579:x1875987796155776:12345-192.168.201.17@tcp:34:lfs.0 Request processed in 1827us (2095us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081701.416069:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 204 00000100:00100000:1.0:1789081701.475955:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081701.476124:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796156032 00000100:00100000:0.0:1789081701.476140:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796156032 00000100:00100000:0.0:1789081701.476254:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 205 00000100:00100000:0.0:1789081701.476270:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+52:11582:x1875987796156032:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:0.0:1789081701.476306:0:9245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081701.476345:0:9245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d6054a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ab83 expref: -99 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.476466:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60551 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.476493:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60551 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.476512:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60551 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.476657:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d60558 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.476672:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d60558 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.476684:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d60558 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.476921:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d6055f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.476935:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d6055f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.476947:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d6055f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789081701.476966:0:9245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789081701.477119:0:9245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60551 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.477130:0:9245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60551 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.477139:0:9245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60551 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.477149:0:9245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101982600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081701.477157:0:9245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60551 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.477196:0:9245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60551 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.477219:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e10c7ecf100) 00010000:00010000:0.0:1789081701.477224:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081701.477232:0:9245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60551 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.477243:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60551 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.477270:0:9245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d60558 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.477281:0:9245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d60558 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.477291:0:9245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d60558 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.477299:0:9245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101982e00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081701.477303:0:9245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d60558 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.477312:0:9245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d60558 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.477324:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e10d19d3000) 00010000:00010000:0.0:1789081701.477329:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081701.477334:0:9245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d60558 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.477364:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d60558 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.477455:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d6054a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab83 expref: 55 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.477482:0:9245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d6055f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab83 expref: 54 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.477495:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e10d046ff00) 00010000:00010000:0.0:1789081701.477499:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789081701.477505:0:9245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101982400, rc 0) 00000100:00100000:0.0:1789081701.477763:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+54:11582:x1875987796156032:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 1497us (1825us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1789081701.477777:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 205 00000100:00100000:1.0:1789081701.485178:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081701.485304:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796156160 00000100:00100000:0.0:1789081701.485320:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796156160 00000100:00100000:0.0:1789081701.485430:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 206 00000100:00100000:0.0:1789081701.485442:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff5df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+54:11582:x1875987796156160:12345-192.168.201.17@tcp:54:lfs.0 00010000:00010000:0.0:1789081701.485632:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d6056d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.485658:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d6056d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.485678:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d6056d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.485757:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d6056d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.485767:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d6056d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.485776:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d6056d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.485787:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101983600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081701.485795:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d6056d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.485808:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d6056d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.485832:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e10d046ff00) 00010000:00010000:0.0:1789081701.485837:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789081701.485844:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d6056d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.485856:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d6056d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081701.485979:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff5df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+54:11582:x1875987796156160:12345-192.168.201.17@tcp:54:lfs.0 Request processed in 533us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081701.485995:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 206 00000100:00100000:2.0:1789081701.491894:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081701.492169:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796156416 00000100:00100000:3.0:1789081701.492184:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796156416 00000100:00100000:3.0:1789081701.492310:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 58 00000100:00100000:3.0:1789081701.492329:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+54:11582:x1875987796156416:12345-192.168.201.17@tcp:35:lfs.0 00000100:00100000:2.0:1789081701.493291:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+55:11582:x1875987796156416:12345-192.168.201.17@tcp:35:lfs.0 Request processed in 959us (1402us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1789081701.493306:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 58 00000100:00100000:1.0:1789081701.600898:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081701.601332:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796156672 00000100:00100000:0.0:1789081701.601346:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796156672 00000100:00100000:0.0:1789081701.604385:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 207 00000100:00100000:0.0:1789081701.604476:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff5dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+55:11592:x1875987796156672:12345-192.168.201.17@tcp:101:bash.0 00010000:00010000:0.0:1789081701.604569:0:7252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081701.604575:0:7252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789081701.604640:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999000/0xb7cb3d7479d604ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab67 expref: 55 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.604678:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e10c7ecf100) 00010000:00010000:0.0:1789081701.604687:0:7252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789081701.604715:0:7252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d60574 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ab8a expref: -99 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.604921:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d6057b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.604945:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d6057b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.604963:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d6057b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789081701.604983:0:7252:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789081701.608464:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d60574 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab8a expref: 57 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.608499:0:7252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d6057b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab8a expref: 56 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.608510:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e10d046ff00) 00010000:00010000:0.0:1789081701.608513:0:7252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789081701.608556:0:7252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101982600, rc 0) 00000100:00100000:0.0:1789081701.608668:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff5dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+56:11592:x1875987796156672:12345-192.168.201.17@tcp:101:bash.0 Request processed in 4212us (7783us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1789081701.608679:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 207 00000100:00100000:0.0:1789081701.620655:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081701.620759:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796156800 00000100:00100000:1.0:1789081701.620771:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796156800 00000100:00100000:1.0:1789081701.620872:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 16 00000100:00100000:1.0:1789081701.620885:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41476931-e751-413e-b98c-64d4d0edcd05+56:2348:x1875987796156800:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789081701.620910:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789081701.620976:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d6057b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab8a expref: 56 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081701.621025:0:7481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e10d046ff00) 00010000:00010000:1.0:1789081701.621034:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789081701.621134:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41476931-e751-413e-b98c-64d4d0edcd05+55:2348:x1875987796156800:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 248us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081701.621148:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 16 00000100:00100000:3.0:1789081701.627804:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081701.631127:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796157056 00000100:00100000:0.0:1789081701.631148:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796157056 00000100:00100000:2.0:1789081701.634979:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 208 00000100:00100000:2.0:1789081701.634997:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+55:11592:x1875987796157056:12345-192.168.201.17@tcp:36:bash.0 00010000:00010000:2.0:1789081701.635110:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789081701.635149:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d6055f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab83 expref: 55 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.635176:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e10d046ff00) 00010000:00010000:2.0:1789081701.635182:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789081701.635490:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d60589 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.635507:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d60589 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.635518:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d60589 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789081701.635664:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:2.0:1789081701.635711:0:5791:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d29f654d reply state 000000003f04a8e1 transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d60589 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081701.635726:0:5791:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789081701.635920:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+57:11592:x1875987796157056:12345-192.168.201.17@tcp:36:bash.0 Request processed in 918us (8126us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1789081701.635935:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 208 00000020:00080000:2.0:1789081701.635943:0:5791:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789081701.644431:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081701.645966:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796157184 00000100:00100000:1.0:1789081701.645986:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796157184 00000100:00100000:1.0:1789081701.646098:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 209 00000100:00100000:1.0:1789081701.646110:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff646680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+57:11592:x1875987796157184:12345-192.168.201.17@tcp:101:bash.0 00010000:00010000:1.0:1789081701.646144:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081701.646177:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0a00/0xb7cb3d7479d60590 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ab91 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081701.646671:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0000/0xb7cb3d7479d60597 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081701.646695:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d60589 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081701.646709:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0000/0xb7cb3d7479d60597 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081701.646742:0:5790:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d60589 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081701.646760:0:5790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0000/0xb7cb3d7479d60597 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.655982:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d60589 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.656017:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d60589 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.656027:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d60589 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.656035:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101775c00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081701.656042:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d60589 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.656051:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d60589 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.656076:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e10d046ff00) 00010000:00010000:0.0:1789081701.656079:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081701.656084:0:3289:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0000/0xb7cb3d7479d60597 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.656096:0:3289:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0000/0xb7cb3d7479d60597 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.656105:0:3289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0000/0xb7cb3d7479d60597 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081701.656637:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d60589 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081701.656648:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d60589 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081701.656749:0:5790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0000/0xb7cb3d7479d60597 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081701.656758:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0000/0xb7cb3d7479d60597 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789081701.656823:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789081701.656829:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789081701.656856:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0000/0xb7cb3d7479d60597 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081701.656902:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0a00/0xb7cb3d7479d60590 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab91 expref: 58 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081701.656934:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0000/0xb7cb3d7479d60597 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab91 expref: 57 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081701.656943:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e10d046ff00) 00010000:00010000:3.0:1789081701.656946:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789081701.656948:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10d1bd0000, rc 0) 00000100:00100000:3.0:1789081701.657059:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff646680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+57:11592:x1875987796157184:12345-192.168.201.17@tcp:101:bash.0 Request processed in 10948us (12644us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081701.657069:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 209 00000100:00100000:3.0:1789081701.677154:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081701.683926:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796157440 00000100:00100000:0.0:1789081701.683950:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796157440 00000100:00100000:2.0:1789081701.684312:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 59 00000100:00100000:2.0:1789081701.684328:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d16c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+57:11592:x1875987796157440:12345-192.168.201.17@tcp:35:bash.0 00000100:00100000:2.0:1789081701.684895:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d16c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+58:11592:x1875987796157440:12345-192.168.201.17@tcp:35:bash.0 Request processed in 569us (7754us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1789081701.684904:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 59 00000100:00100000:1.0:1789081701.725189:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789081701.725237:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821308544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789081701.725342:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081701.725673:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821308544 00000100:00100000:3.0:1789081701.725684:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821308544 00000100:00100000:3.0:1789081701.725767:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789081701.725779:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875987821308544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789081701.725854:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789081701.725858:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789081701.725933:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875987821308544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 156us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081701.725942:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789081701.726161:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821308544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789081701.726205:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5f07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821308672:0@lo:400:kworker.0 00000100:00100000:1.0:1789081701.726252:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081701.726301:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875987821309056:0@lo:400:kworker.0 00000100:00100000:0.0:1789081701.726341:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081701.726958:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821309056 00000100:00100000:1.0:1789081701.726965:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821309056 00000100:00100000:1.0:1789081701.727044:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789081701.727054:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5dd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875987821309056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081701.727115:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5dd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875987821309056:12345-0@lo:400:kworker.0 Request processed in 63us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081701.727123:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789081701.727173:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875987821309056:0@lo:400:kworker.0 00000100:00100000:3.0:1789081701.727197:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875987821308928:0@lo:400:kworker.0 00000100:00100000:3.0:1789081701.727236:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081701.727258:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789081701.727263:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875987821308800:0@lo:400:kworker.0 00000100:00100000:3.0:1789081701.727286:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789081701.727480:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789081701.727573:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821308672 00000100:00100000:2.0:1789081701.727588:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821308672 00000100:00100000:2.0:1789081701.727630:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1789081701.727638:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3306:x1875987821308672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789081701.727692:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3306:x1875987821308672:12345-0@lo:400:kworker.0 Request processed in 55us (1440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081701.727698:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1789081701.727730:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821308928 00000100:00100000:2.0:1789081701.727733:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821308928 00000100:00080000:2.0:1789081701.727749:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789081701.727771:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821308800 00000100:00100000:2.0:1789081701.727774:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821308800 00000100:00100000:2.0:1789081701.727798:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789081701.727805:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5a69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875987821308928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789081701.727841:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5a69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875987821308928:12345-0@lo:400:kworker.0 Request processed in 37us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081701.727847:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789081701.727858:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789081701.727864:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1029c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875987821308800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789081701.727890:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1029c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875987821308800:12345-0@lo:400:kworker.0 Request processed in 26us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081701.727896:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789081701.727952:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875987821308800:0@lo:400:kworker.0 00000100:00100000:2.0:1789081701.727962:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875987821308928:0@lo:400:kworker.0 00000100:00100000:1.0:1789081701.728125:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5f07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821308672:0@lo:400:kworker.0 00000100:00100000:1.0:1789081701.777276:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081701.777508:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796157568 00000100:00100000:0.0:1789081701.777568:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796157568 00000100:00100000:0.0:1789081701.777664:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 210 00000100:00100000:0.0:1789081701.777678:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+58:11598:x1875987796157568:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:3.0:1789081701.777797:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081701.777829:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d6059e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ab98 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081701.778101:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d605a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081701.778120:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d605a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081701.778133:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d605a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789081701.778217:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1789081701.778221:0:5789:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789081701.778251:0:5789:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d605a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081701.778281:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d6059e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab98 expref: 60 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081701.778302:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d605a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab98 expref: 59 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081701.778311:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e10c7ecf100) 00010000:00010000:3.0:1789081701.778315:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789081701.778319:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101998000, rc 0) 00000100:00100000:3.0:1789081701.778412:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+59:11598:x1875987796157568:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 738us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081701.778419:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 210 00000100:00100000:3.0:1789081701.785970:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081701.786156:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796157696 00000100:00100000:2.0:1789081701.786170:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796157696 00000100:00100000:2.0:1789081701.786283:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 211 00000100:00100000:2.0:1789081701.786296:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d11fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+59:11598:x1875987796157696:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:2.0:1789081701.786328:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081701.786368:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775e00/0xb7cb3d7479d605ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ab9f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.786499:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d605b3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.786599:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d605b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.786621:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d605b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.786647:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d605ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.786659:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d605ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.786670:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d605ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.786841:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d605c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.786855:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d605c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.786865:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d605c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789081701.786933:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789081701.786938:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789081701.786970:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d605c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.786990:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d605c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.787118:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d605b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.787129:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d605b3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.787139:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d605b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.787148:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101774c00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081701.787156:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d605b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.787169:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d605b3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.787192:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e10c7ecf100) 00010000:00010000:2.0:1789081701.787195:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081701.787201:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d605b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.787209:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d605b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.787237:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d605ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.787244:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d605ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.787250:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d605ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.787255:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101774400 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081701.787258:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d605ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.787264:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d605ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.787272:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e10c9a92400) 00010000:00010000:2.0:1789081701.787274:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081701.787277:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d605ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.787283:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d605ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.787321:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775e00/0xb7cb3d7479d605ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab9f expref: 61 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.787343:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d605c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab9f expref: 60 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.787379:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e10d046ff00) 00010000:00010000:2.0:1789081701.787384:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789081701.787389:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101775000, rc 0) 00000100:00100000:2.0:1789081701.788194:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d11fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+60:11598:x1875987796157696:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 1894us (2232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081701.788207:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 211 00000100:00100000:1.0:1789081701.800215:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081701.800355:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796157824 00000100:00100000:0.0:1789081701.800370:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796157824 00000100:00100000:0.0:1789081701.800472:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 17 00000100:00100000:0.0:1789081701.800485:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff5df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41476931-e751-413e-b98c-64d4d0edcd05+60:2350:x1875987796157824:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789081701.800505:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789081701.800991:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d605c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab9f expref: 60 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.801023:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e10d046ff00) 00010000:00010000:0.0:1789081701.801029:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789081701.801107:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff5df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41476931-e751-413e-b98c-64d4d0edcd05+59:2350:x1875987796157824:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 625us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081701.801116:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 17 00000100:00100000:1.0:1789081701.810147:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081701.810285:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796158080 00000100:00100000:2.0:1789081701.810298:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796158080 00000100:00100000:2.0:1789081701.810427:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 212 00000100:00100000:2.0:1789081701.810448:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+59:11598:x1875987796158080:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:2.0:1789081701.810483:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081701.810604:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775e00/0xb7cb3d7479d605c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2aba6 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.810788:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d605cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.810813:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0000/0xb7cb3d7479d60597 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab91 expref: 60 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.810827:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d605cf lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.810882:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0000/0xb7cb3d7479d60597 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab91 expref: 60 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.810898:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0000/0xb7cb3d7479d60597 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab91 expref: 60 pid: 5790 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081701.810937:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5790:1875987821309184:192.168.201.17@tcp:104: 00000100:00100000:2.0:1789081701.811068:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10f1240f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789081701.816183:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5790:1875987821309184:192.168.201.17@tcp:104: 00010000:00010000:2.0:1789081701.816222:0:5790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d605cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081701.817936:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081701.818065:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796158208 00000100:00100000:2.0:1789081701.818083:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796158208 00010000:00010000:2.0:1789081701.818140:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0000/0xb7cb3d7479d60597 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab91 expref: 61 pid: 5790 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081701.818193:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 79 00000100:00100000:2.0:1789081701.818204:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c9388050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41476931-e751-413e-b98c-64d4d0edcd05+61:2350:x1875987796158208:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789081701.818225:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789081701.818234:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0000/0xb7cb3d7479d60597 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab91 expref: 61 pid: 5790 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.818250:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0000/0xb7cb3d7479d60597 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab91 expref: 61 pid: 5790 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.818279:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0000/0xb7cb3d7479d60597 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab91 expref: 61 pid: 5790 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.818300:0:7481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e10d046ff00) 00010000:00010000:2.0:1789081701.818308:0:7481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d605cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.818336:0:7481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d605cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.818344:0:7481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d605cf lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.818384:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789081701.818458:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c9388050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41476931-e751-413e-b98c-64d4d0edcd05+60:2350:x1875987796158208:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 256us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081701.818468:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 79 00010000:00010000:3.0:1789081701.818506:0:5790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d605cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081701.818572:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d605cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789081701.818611:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789081701.818861:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775e00/0xb7cb3d7479d605c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aba6 expref: 61 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081701.818885:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d605cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aba6 expref: 60 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081701.818893:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e10d046ff00) 00010000:00010000:3.0:1789081701.818896:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789081701.818901:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101774400, rc 0) 00000100:00100000:3.0:1789081701.818934:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+60:11598:x1875987796158080:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 8496us (8804us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1789081701.818942:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 212 00000100:00100000:3.0:1789081701.841743:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081701.842032:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796158464 00000100:00100000:1.0:1789081701.842045:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796158464 00000100:00100000:1.0:1789081701.842125:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 18 00000100:00100000:1.0:1789081701.842134:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d11ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41476931-e751-413e-b98c-64d4d0edcd05+60:11598:x1875987796158464:12345-192.168.201.17@tcp:103:lfs.0 00010000:00010000:1.0:1789081701.842154:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789081701.842183:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999e00/0xb7cb3d7479d6052e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab7c expref: 60 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081701.842206:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e10d046ff00) 00010000:00010000:1.0:1789081701.842212:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789081701.842283:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d11ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41476931-e751-413e-b98c-64d4d0edcd05+59:11598:x1875987796158464:12345-192.168.201.17@tcp:103:lfs.0 Request processed in 150us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081701.842292:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 18 00000100:00100000:1.0:1789081701.851707:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081701.851877:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796158592 00000100:00100000:2.0:1789081701.851900:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796158592 00000100:00100000:2.0:1789081701.851984:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 213 00000100:00100000:2.0:1789081701.851997:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+59:11598:x1875987796158592:12345-192.168.201.17@tcp:58:lfs.0 00010000:00010000:2.0:1789081701.852161:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d605dd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.852183:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d605dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081701.852198:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d605dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789081701.852445:0:7252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1789081701.852654:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+59:11598:x1875987796158592:12345-192.168.201.17@tcp:58:lfs.0 Request processed in 659us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081701.852663:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 213 00000100:00100000:2.0:1789081701.857427:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081701.857655:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796158720 00000100:00100000:0.0:1789081701.857671:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796158720 00000100:00100000:0.0:1789081701.857748:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 214 00000100:00100000:0.0:1789081701.857758:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11006a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+59:11598:x1875987796158720:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:0.0:1789081701.857800:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081701.857826:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d605e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2abad expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.857912:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d605dd lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.857922:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d605e4 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abad expref: 60 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.857943:0:5791:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d605dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.857954:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d605e4 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abad expref: 60 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.857967:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e10d046ff00) 00010000:00010000:0.0:1789081701.857970:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789081701.857973:0:5791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d605e4 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abad expref: 60 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081701.857980:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101983600, rc 0) 00000100:00100000:0.0:1789081701.858044:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11006a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+60:11598:x1875987796158720:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 289us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081701.858049:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 214 00010000:00010000:0.0:1789081702.172813:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081702.360351:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081702.360671:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081702.360705:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081702.360746:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081702.360780:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081702.360852:0:7788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796159232 00000100:00100000:0.0:1789081702.360883:0:7788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796159232 00000100:00100000:0.0:1789081702.361004:0:7788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796159104 00000100:00100000:0.0:1789081702.361018:0:7788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796159104 00000100:00100000:0.0:1789081702.361049:0:7788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 59 00000100:00100000:0.0:1789081702.361062:0:7788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41476931-e751-413e-b98c-64d4d0edcd05+9:2349:x1875987796159232:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:0.0:1789081702.361192:0:7788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41476931-e751-413e-b98c-64d4d0edcd05+9:2349:x1875987796159232:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 122us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081702.361201:0:7788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 59 00000100:00100000:0.0:1789081702.361232:0:7788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 60 00000100:00100000:0.0:1789081702.361240:0:7788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41476931-e751-413e-b98c-64d4d0edcd05+7:2349:x1875987796159104:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:0.0:1789081702.361266:0:7788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41476931-e751-413e-b98c-64d4d0edcd05+7:2349:x1875987796159104:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 28us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081702.361272:0:7788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 60 00000100:00080000:0.0:1789081702.361329:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789081702.361333:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789081702.364393:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796158848 00000100:00100000:1.0:1789081702.364417:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796158848 00000100:00100000:1.0:1789081702.364504:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 300 00000100:00100000:1.0:1789081702.364516:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2349:x1875987796158848:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:1.0:1789081702.364677:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2349:x1875987796158848:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 163us (3970us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081702.364687:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 300 00000100:00100000:2.0:1789081702.371742:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796158976 00000100:00100000:2.0:1789081702.371790:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796158976 00000100:00080000:2.0:1789081702.371846:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789081702.371918:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796159360 00000100:00100000:2.0:1789081702.371922:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796159360 00000100:00080000:2.0:1789081702.371935:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789081702.371971:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 166 00000100:00100000:2.0:1789081702.371983:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+60:2349:x1875987796158976:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:2.0:1789081702.372112:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+60:2349:x1875987796158976:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 131us (11776us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081702.372121:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 166 00000100:00100000:2.0:1789081702.372145:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 167 00000100:00100000:2.0:1789081702.372152:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03f7db20-3934-4266-b84f-346a4ea22636+5:2349:x1875987796159360:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:2.0:1789081702.372179:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03f7db20-3934-4266-b84f-346a4ea22636+5:2349:x1875987796159360:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 28us (11398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081702.372185:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 167 00000040:00080000:2.0:1789081702.812964:0:11539:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789081702.812988:0:11539:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789081702.813073:0:11539:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1789081702.813081:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789081702.813273:0:11539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11006a5880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11539:1875987821309312:192.168.201.17@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789081702.815969:0:11539:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d106d480 going to sleep for 11 seconds 00000100:00100000:2.0:1789081702.828017:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081702.828109:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796159488 00000100:00100000:3.0:1789081702.828122:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796159488 00000100:00100000:3.0:1789081702.828201:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 215 00000100:00100000:3.0:1789081702.828213:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11006a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+61:11599:x1875987796159488:12345-192.168.201.17@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789081702.828275:0:5789:0:(mdt_handler.c:8081:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789081702.828424:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11006a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+61:11599:x1875987796159488:12345-192.168.201.17@tcp:53:lhsmtool_posix.0 Request processed in 213us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081702.828434:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 215 00000100:00100000:1.0:1789081702.829354:0:11539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11006a5880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11539:1875987821309312:192.168.201.17@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789081702.842864:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081702.843139:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796159616 00000100:00100000:2.0:1789081702.843155:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796159616 00000100:00100000:2.0:1789081702.843246:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 216 00000100:00100000:2.0:1789081702.843258:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+60:11599:x1875987796159616:12345-192.168.201.17@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789081702.843859:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d605eb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081702.843885:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d605eb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081702.843901:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d605eb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081702.843921:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d605f2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081702.843928:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d605f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081702.843934:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d605f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081702.844321:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d605f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081702.844333:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d605f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081702.844341:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d605f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789081702.844395:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789081702.844399:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789081702.844417:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d605f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081702.844430:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d605eb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081702.844453:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d605eb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081702.844460:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d605eb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081702.844478:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101774800 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081702.844483:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d605eb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081702.844498:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d605eb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081702.844514:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e10d046fc00) 00010000:00010000:2.0:1789081702.845033:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081702.845042:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d605eb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081702.845050:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d605eb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081702.845069:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d605f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081702.845075:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d605f2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081702.845081:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d605f2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081702.845086:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101774000 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081702.845097:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d605f2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081702.845103:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d605f2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081702.845113:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9e10c9a92400) 00010000:00010000:2.0:1789081702.845115:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081702.845118:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d605f2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081702.845124:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774000/0xb7cb3d7479d605f2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081702.845141:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d605f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081702.845147:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d605f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081702.845153:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d605f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081702.845159:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101775600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081702.845162:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d605f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081702.845169:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d605f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081702.845176:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e10d046ff00) 00010000:00010000:2.0:1789081702.845179:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081702.845188:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d605f9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081702.845194:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775600/0xb7cb3d7479d605f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081702.845402:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+60:11599:x1875987796159616:12345-192.168.201.17@tcp:34:lhsmtool_posix.0 Request processed in 2139us (2546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081702.845414:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 216 00000100:00100000:0.0:1789081702.868059:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081702.868310:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796159872 00000100:00100000:1.0:1789081702.868342:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796159872 00000100:00100000:1.0:1789081702.868427:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 217 00000100:00100000:1.0:1789081702.868440:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+60:11599:x1875987796159872:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789081702.868472:0:7252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081702.868504:0:7252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1e00/0xb7cb3d7479d60600 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2abb4 expref: -99 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081702.868689:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1600/0xb7cb3d7479d60607 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081702.868828:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1600/0xb7cb3d7479d60607 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081702.868844:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1600/0xb7cb3d7479d60607 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789081702.868859:0:7252:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789081702.869202:0:7252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1600/0xb7cb3d7479d60607 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081702.869211:0:7252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1600/0xb7cb3d7479d60607 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081702.869218:0:7252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1600/0xb7cb3d7479d60607 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081702.869224:0:7252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10d1bd1600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081702.869230:0:7252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1600/0xb7cb3d7479d60607 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081702.869238:0:7252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1600/0xb7cb3d7479d60607 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081702.869263:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e10d046ff00) 00010000:00010000:1.0:1789081702.869266:0:7252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789081702.869272:0:7252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1600/0xb7cb3d7479d60607 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081702.869279:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1600/0xb7cb3d7479d60607 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081702.869339:0:7252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1e00/0xb7cb3d7479d60600 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abb4 expref: 62 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081702.869353:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e10d046fc00) 00010000:00010000:1.0:1789081702.869356:0:7252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789081702.869360:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1e00/0xb7cb3d7479d60600 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abb4 expref: 62 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081702.869371:0:7252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10d1bd1e00, rc 0) 00000100:00100000:1.0:1789081702.869475:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+61:11599:x1875987796159872:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 1037us (1432us total) trans 4294967504 rc 301/301 00000100:00100000:1.0:1789081702.869484:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 217 00000100:00100000:2.0:1789081702.877260:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081702.877372:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796160000 00000100:00100000:3.0:1789081702.877387:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796160000 00000100:00100000:3.0:1789081702.877822:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 218 00000100:00100000:1.0:1789081702.877905:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11006a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+61:11599:x1875987796160000:12345-192.168.201.17@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789081702.878001:0:5790:0:(mdt_handler.c:8081:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789081702.878152:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11006a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+61:11599:x1875987796160000:12345-192.168.201.17@tcp:53:lhsmtool_posix.0 Request processed in 318us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081702.878162:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 218 00000100:00100000:2.0:1789081702.896130:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081702.896353:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796160256 00000100:00100000:0.0:1789081702.896368:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796160256 00000100:00100000:0.0:1789081702.896472:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 219 00000100:00100000:0.0:1789081702.896486:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11006a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+61:11599:x1875987796160256:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789081702.896519:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081702.896577:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789081702.896618:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998000/0xb7cb3d7479d605a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab98 expref: 61 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081702.896642:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e10c7ecf100) 00010000:00010000:0.0:1789081702.896649:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789081702.896703:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d60615 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2abbb expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789081702.898115:0:5791:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:0.0:1789081702.898415:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d6061c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081702.898436:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d6061c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081702.898451:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d6061c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081702.899028:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d60615 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abbb expref: 63 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081702.899055:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d6061c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abbb expref: 62 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081702.899064:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e10d19d3000) 00010000:00010000:0.0:1789081702.899067:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789081702.899071:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101983c00, rc 0) 00000100:00100000:0.0:1789081702.899513:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11006a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+62:11599:x1875987796160256:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 3028us (3395us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1789081702.899570:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 219 00000100:00100000:2.0:1789081702.918279:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081702.919430:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796160512 00000100:00100000:3.0:1789081702.919450:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796160512 00000100:00100000:0.0:1789081702.919590:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 220 00000100:00100000:0.0:1789081702.919610:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11006a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+62:11599:x1875987796160512:12345-192.168.201.17@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789081702.920235:0:9245:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789081702.920297:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d6061c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abbb expref: 62 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081702.920325:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e10d19d3000) 00010000:00010000:0.0:1789081702.920340:0:9245:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789081702.920372:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d6062a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081702.920389:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d6062a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081702.920401:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d6062a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081702.920417:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d60631 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x3ee589ba bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081702.923660:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d60631 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3ee589ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081702.923691:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d60631 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3ee589ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081702.923821:0:9245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d6062a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081702.923830:0:9245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d6062a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081702.923839:0:9245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d6062a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081702.923846:0:9245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101982e00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081702.923872:0:9245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d6062a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081702.923881:0:9245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d6062a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081702.923897:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e10c7ecf100) 00010000:00010000:0.0:1789081702.923900:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081702.923906:0:9245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d6062a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081702.923913:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d6062a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081702.923930:0:9245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d60631 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3ee589ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081702.923937:0:9245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d60631 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3ee589ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081702.923943:0:9245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d60631 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3ee589ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081702.923949:0:9245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101983400 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081702.923952:0:9245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d60631 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3ee589ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081702.923958:0:9245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d60631 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3ee589ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081702.923965:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x3ee589ba (ffff9e10d19d3600) 00010000:00010000:0.0:1789081702.923967:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081702.923977:0:9245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d60631 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x3ee589ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081702.923983:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d60631 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x3ee589ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081702.924609:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11006a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+61:11599:x1875987796160512:12345-192.168.201.17@tcp:36:lhsmtool_posix.0 Request processed in 4998us (6337us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789081702.924622:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 220 00000100:00100000:2.0:1789081702.928948:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081702.929040:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796160640 00000100:00100000:1.0:1789081702.929084:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796160640 00000100:00100000:1.0:1789081702.929178:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 221 00000100:00100000:1.0:1789081702.929192:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11006a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+61:11599:x1875987796160640:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789081702.929225:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081702.929259:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1e00/0xb7cb3d7479d60638 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2abc2 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081702.929308:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1600/0xb7cb3d7479d6063f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081702.929325:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1600/0xb7cb3d7479d6063f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081702.929339:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1600/0xb7cb3d7479d6063f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081702.929468:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1e00/0xb7cb3d7479d60638 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abc2 expref: 63 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081702.929489:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1600/0xb7cb3d7479d6063f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abc2 expref: 62 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081702.929499:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e10c7ecff00) 00010000:00010000:1.0:1789081702.929502:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789081702.929506:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10d1bd1600, rc 0) 00000100:00100000:1.0:1789081702.929655:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11006a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+62:11599:x1875987796160640:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 465us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081702.929664:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 221 00000100:00100000:2.0:1789081702.958508:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081702.964790:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796160896 00000100:00100000:0.0:1789081702.964817:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796160896 00000100:00100000:0.0:1789081702.964929:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 222 00000100:00100000:0.0:1789081702.964942:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11006a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+62:11599:x1875987796160896:12345-192.168.201.17@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789081702.965581:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d60646 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081702.965606:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d60646 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081702.965622:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d60646 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789081702.965958:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:0.0:1789081702.965969:0:5791:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 369848444646ns, next at 370848440787ns, rc = 0 00000004:00010000:0.0:1789081702.969757:0:5791:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a9b36792 reply state 00000000a6606109 transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d60646 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081702.969781:0:5791:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789081702.969955:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11006a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+64:11599:x1875987796160896:12345-192.168.201.17@tcp:36:lhsmtool_posix.0 Request processed in 5011us (11457us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1789081702.975164:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 222 00010000:00010000:3.0:1789081702.977399:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d60646 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081702.977422:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d60646 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081702.977431:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d60646 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081702.977438:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101983400 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081702.977444:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d60646 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081702.977452:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d60646 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081702.977474:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e10c7ecff00) 00010000:00010000:3.0:1789081702.977477:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789081702.977482:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d60646 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081702.977490:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d60646 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081702.981133:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081702.982816:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796161024 00000100:00100000:0.0:1789081702.982840:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796161024 00000100:00100000:0.0:1789081702.982944:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 223 00000100:00100000:0.0:1789081702.982956:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+63:11599:x1875987796161024:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789081702.982999:0:9245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081702.983031:0:9245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d6064d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2abc9 expref: -99 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081702.983119:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d6064d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abc9 expref: 64 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081702.983136:0:9245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d6064d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abc9 expref: 64 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081702.983160:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e10c7ecff00) 00010000:00010000:0.0:1789081702.983163:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789081702.983168:0:9245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101982e00, rc 0) 00000100:00100000:0.0:1789081702.983278:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+64:11599:x1875987796161024:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 315us (2149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081702.983287:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 223 00000100:00100000:0.0:1789081702.993167:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081702.993310:0:7788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796161152 00000100:00100000:2.0:1789081702.993325:0:7788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796161152 00000100:00100000:2.0:1789081702.993478:0:7788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 62 00000100:00100000:2.0:1789081702.993491:0:7788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c8a1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41476931-e751-413e-b98c-64d4d0edcd05+9:2351:x1875987796161152:12345-192.168.201.17@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789081703.007094:0:7788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c8a1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41476931-e751-413e-b98c-64d4d0edcd05+10:2351:x1875987796161152:12345-192.168.201.17@tcp:2:lhsmtool_posix.0 Request processed in 13588us (13924us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1789081703.007145:0:7788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 62 00000100:00100000:2.0:1789081703.029265:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081703.029419:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796161408 00000100:00100000:0.0:1789081703.029433:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796161408 00000100:00100000:0.0:1789081703.029520:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 60 00000100:00100000:0.0:1789081703.029613:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+64:11599:x1875987796161408:12345-192.168.201.17@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789081703.030049:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+65:11599:x1875987796161408:12345-192.168.201.17@tcp:35:lhsmtool_posix.0 Request processed in 439us (796us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1789081703.030062:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 60 00000100:00100000:3.0:1789081703.043188:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081703.043458:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796161664 00000100:00100000:2.0:1789081703.043472:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796161664 00000100:00100000:2.0:1789081703.043659:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 224 00000100:00100000:2.0:1789081703.043673:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+65:11599:x1875987796161664:12345-192.168.201.17@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789081703.043855:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+65:11599:x1875987796161664:12345-192.168.201.17@tcp:57:lhsmtool_posix.0 Request processed in 185us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081703.043863:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 224 00000100:00100000:1.0:1789081703.070447:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081703.070597:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796161792 00000100:00100000:0.0:1789081703.070616:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796161792 00000100:00100000:0.0:1789081703.070735:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 225 00000100:00100000:0.0:1789081703.070754:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+65:11599:x1875987796161792:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789081703.070796:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081703.070838:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d60654 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2abd0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.070960:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d6065b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.071009:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d6065b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.071028:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d6065b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789081703.071087:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789081703.071112:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d6065b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.071143:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d60654 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abd0 expref: 67 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.071166:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d6065b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abd0 expref: 66 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.071207:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e10c7ecff00) 00010000:00010000:0.0:1789081703.071211:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789081703.071215:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101983000, rc 0) 00000100:00100000:0.0:1789081703.071303:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+66:11599:x1875987796161792:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 556us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081703.071311:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 225 00000100:00100000:3.0:1789081703.078824:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081703.078908:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796161920 00000100:00100000:0.0:1789081703.078924:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796161920 00000100:00100000:0.0:1789081703.079053:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 63 00000100:00100000:0.0:1789081703.079067:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41476931-e751-413e-b98c-64d4d0edcd05+10:2349:x1875987796161920:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789081703.079094:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081703.079125:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3b87205/0xb7cb3d7479d60662 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2abd7 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789081703.079165:0:6581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa33866, blocks: 0x1 00010000:00010000:0.0:1789081703.079192:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=369s v=(0 0) 00010000:00010000:0.0:1789081703.079199:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789081703.079213:0:6581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3b87205/0xb7cb3d7479d60662 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abd7 expref: 11 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.079234:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a3b87205/0xb7cb3d7479d60662 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abd7 expref: 11 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.079251:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101983800, rc 0) 00000100:00100000:0.0:1789081703.079371:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41476931-e751-413e-b98c-64d4d0edcd05+11:2349:x1875987796161920:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 308us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081703.079380:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 63 00000100:00100000:3.0:1789081703.093960:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081703.094102:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796162176 00000100:00100000:1.0:1789081703.094120:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796162176 00000100:00100000:1.0:1789081703.094223:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 226 00000100:00100000:1.0:1789081703.094236:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+66:11599:x1875987796162176:12345-192.168.201.17@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789081703.094418:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+66:11599:x1875987796162176:12345-192.168.201.17@tcp:57:lhsmtool_posix.0 Request processed in 183us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081703.094428:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 226 00000100:00100000:1.0:1789081703.113080:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081703.113248:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796162304 00000100:00100000:0.0:1789081703.113261:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796162304 00000100:00100000:0.0:1789081703.113341:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 64 00000100:00100000:0.0:1789081703.113354:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41476931-e751-413e-b98c-64d4d0edcd05+11:11599:x1875987796162304:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789081703.113384:0:6582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081703.113415:0:6582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c88e852/0xb7cb3d7479d60669 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2abde expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.113467:0:6582:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a3b87205/0xb7cb3d7479d60662 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abd7 expref: 12 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.113478:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789081703.113484:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789081703.113491:0:6582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c88e852/0xb7cb3d7479d60669 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abde expref: 12 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.113601:0:6582:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a3b87205/0xb7cb3d7479d60662 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abd7 expref: 12 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.113624:0:6582:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a3b87205/0xb7cb3d7479d60662 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abd7 expref: 12 pid: 6581 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081703.113649:0:6582:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c8a1c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6582:1875987821309440:192.168.201.17@tcp:104: 00000100:00100000:0.0:1789081703.113869:0:6582:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c9167e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789081703.121279:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081703.121462:0:6582:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c8a1c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6582:1875987821309440:192.168.201.17@tcp:104: 00010000:00010000:0.0:1789081703.121514:0:6582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002c88e852/0xb7cb3d7479d60669 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abde expref: 12 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.121610:0:6582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101983400, rc 0) 00000100:00100000:3.0:1789081703.121865:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796162432 00000100:00100000:3.0:1789081703.121874:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796162432 00010000:00010000:3.0:1789081703.121920:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a3b87205/0xb7cb3d7479d60662 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abd7 expref: 13 pid: 6581 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081703.121970:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 80 00000100:00100000:3.0:1789081703.121981:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41476931-e751-413e-b98c-64d4d0edcd05+13:2350:x1875987796162432:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789081703.121999:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081703.122030:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000a3b87205/0xb7cb3d7479d60662 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abd7 expref: 13 pid: 6581 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081703.122874:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a3b87205/0xb7cb3d7479d60662 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abd7 expref: 13 pid: 6581 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081703.122927:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3b87205/0xb7cb3d7479d60662 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abd7 expref: 13 pid: 6581 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081703.122948:0:5774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789081703.122953:0:5774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081703.122962:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002c88e852/0xb7cb3d7479d60669 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abde expref: 12 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081703.123001:0:5774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c88e852/0xb7cb3d7479d60669 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abde expref: 12 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081703.123066:0:5774:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002c88e852/0xb7cb3d7479d60669 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abde expref: 12 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081703.123084:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2def100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5774:1875987821309568:192.168.201.17@tcp:105: 00000100:00100000:0.0:1789081703.123381:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41476931-e751-413e-b98c-64d4d0edcd05+12:11599:x1875987796162304:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 10025us (10313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081703.123392:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 64 00000100:00100000:3.0:1789081703.123762:0:5774:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d0c9ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1789081703.143131:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2def100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5774:1875987821309568:192.168.201.17@tcp:105: 00010000:00010000:3.0:1789081703.143172:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789081703.143254:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41476931-e751-413e-b98c-64d4d0edcd05+11:2350:x1875987796162432:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 21273us (21989us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081703.143267:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 80 00000100:00100000:0.0:1789081703.147466:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081703.147677:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796162560 00000100:00100000:2.0:1789081703.147711:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796162560 00002000:00100000:0.0:1789081703.147859:0:6589:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9e10c8a1c700 x1875987796162560/t0(0) o4->41476931-e751-413e-b98c-64d4d0edcd05@192.168.201.17@tcp:494/0 lens 504/0 e 0 to 0 dl 1789081714 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789081703.147873:0:6589:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e10c8a1c700 with x1875987796162560 ext(0->12) 00002000:00010000:0.0:1789081703.147880:0:6589:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e10c8a1c700 00000100:00100000:0.0:1789081703.147976:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 6 00000100:00100000:0.0:1789081703.147989:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c8a1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41476931-e751-413e-b98c-64d4d0edcd05+11:2351:x1875987796162560:12345-192.168.201.17@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789081703.148849:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c8a1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:41476931-e751-413e-b98c-64d4d0edcd05+13:2351:x1875987796162560:12345-192.168.201.17@tcp:4:lhsmtool_posix.0 Request processed in 856us (1497us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1789081703.148863:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 6 00002000:00100000:0.0:1789081703.148876:0:6589:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9e10c8a1c700 x1875987796162560/t4294967320(0) o4->41476931-e751-413e-b98c-64d4d0edcd05@192.168.201.17@tcp:494/0 lens 504/448 e 0 to 0 dl 1789081714 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789081703.148888:0:6589:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e10c8a1c700 with x1875987796162560 ext(0->12) 00002000:00010000:0.0:1789081703.148894:0:6589:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e10c8a1c700 00000100:00100000:1.0:1789081703.154693:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081703.155361:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796162688 00000100:00100000:2.0:1789081703.155381:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796162688 00000100:00100000:2.0:1789081703.155471:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 227 00000100:00100000:2.0:1789081703.155482:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+66:11599:x1875987796162688:12345-192.168.201.17@tcp:44:lhsmtool_posix.0 00010000:00010000:0.0:1789081703.196761:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789081703.240977:0:5811:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000004:00080000:2.0:1789081703.241008:0:5811:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:2.0:1789081703.241068:0:5811:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:2.0:1789081703.241109:0:5811:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:2.0:1789081703.241120:0:5811:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e10f95bc540 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1789081703.241127:0:5811:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e10c623cb00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e10f95bc3c0 00000020:00080000:2.0:1789081703.241130:0:5811:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e10c623c600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e10ff65f000 00000004:00080000:2.0:1789081703.241158:0:5811:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:2.0:1789081703.241184:0:5811:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e0fc2a36d80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1789081703.241189:0:5811:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e10ffb02400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e0fc2a360c0 00000020:00080000:2.0:1789081703.241200:0:5811:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e10ffb02c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e1101914800 00000020:00080000:3.0:1789081703.241508:0:5822:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1789081703.241851:0:5822:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1789081703.242316:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f96e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821309824:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789081703.242428:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081703.242517:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789081703.242561:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821309952:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789081703.242591:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081703.242635:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821309824 00000100:00100000:0.0:1789081703.242643:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821309824 00000100:00100000:0.0:1789081703.242701:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821309952 00000100:00100000:0.0:1789081703.242704:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821309952 00000100:00100000:0.0:1789081703.242730:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789081703.242740:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1875987821309824:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789081703.242928:0:6581:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789081703.242933:0:6581:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789081703 00002000:00010000:0.0:1789081703.242935:0:6581:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789081703.242938:0:6581:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789081702 -> 1789081703 00002000:00010000:0.0:1789081703.242941:0:6581:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789081703.242990:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3303:x1875987821309824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 249us (560us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1789081703.242998:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789081703.243020:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789081703.243027:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1875987821309952:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789081703.243046:0:6581:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:0.0:1789081703.243082:0:6581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa33864, atime: 0x6aa33865, ctime: 0x6aa33864, blocks: 0x1 00010000:00010000:0.0:1789081703.243092:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053f7e648/0xb7cb3d7479d60670 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.243136:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=370s v=(0 0) 00010000:00010000:0.0:1789081703.243142:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789081703.243150:0:6581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053f7e648/0xb7cb3d7479d60670 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.243171:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053f7e648/0xb7cb3d7479d60670 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.243184:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053f7e648/0xb7cb3d7479d60670 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.243193:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053f7e648/0xb7cb3d7479d60670 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.243214:0:6581:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789081703.243801:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3303:x1875987821309952:12345-0@lo:6:osp-syn-0-0.0 Request processed in 771us (1204us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789081703.243812:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1789081703.243850:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789081703.243856:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1789081703.243905:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e1101ad1c00/2, rc 0, transno 4294967310 00000100:00100000:0.0:1789081703.243912:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821309952:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1789081703.243927:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e10f96e0700/2, rc 0, transno 4294967321 00000100:00100000:0.0:1789081703.243932:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f96e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821309824:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1789081703.243951:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789081703.243965:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053f7e648/0xb7cb3d7479d60670 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.243977:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101983c00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:0.0:1789081703.243981:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053f7e648/0xb7cb3d7479d60670 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.243992:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053f7e648/0xb7cb3d7479d60670 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.244013:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053f7e648/0xb7cb3d7479d60670 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.244020:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053f7e648/0xb7cb3d7479d60670 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.244044:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081703.244046:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081703.244048:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081703.244789:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789081703.244817:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821309696:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789081703.244889:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081703.245759:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821309696 00000100:00100000:0.0:1789081703.245772:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821309696 00000100:00100000:0.0:1789081703.245847:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789081703.245862:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2def100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1875987821309696:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789081703.245905:0:6581:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:0.0:1789081703.245939:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e6216b3/0xb7cb3d7479d60677 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.245967:0:6581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fac1aed6/0xb7cb3d7479d60432 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab3d expref: 12 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.245996:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1789081703.246001:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789081703.246007:0:6581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e6216b3/0xb7cb3d7479d60677 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.246058:0:6581:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fac1aed6/0xb7cb3d7479d60432 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab3d expref: 12 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.246076:0:6581:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fac1aed6/0xb7cb3d7479d60432 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab3d expref: 12 pid: 6581 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081703.246093:0:6581:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff783480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6581:1875987821310080:192.168.201.17@tcp:104: 00000100:00100000:0.0:1789081703.246227:0:6581:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c9167e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789081703.246329:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+20:11599:x1875987796162688:12345-192.168.201.17@tcp:44:lhsmtool_posix.0 Request processed in 90848us (91652us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081703.246339:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 227 00000100:00100000:2.0:1789081703.250723:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081703.251040:0:6581:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff783480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6581:1875987821310080:192.168.201.17@tcp:104: 00010000:00010000:0.0:1789081703.251076:0:6581:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005e6216b3/0xb7cb3d7479d60677 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081703.251151:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081703.251266:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796162816 00000100:00100000:2.0:1789081703.251275:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796162816 00010000:00010000:2.0:1789081703.251325:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fac1aed6/0xb7cb3d7479d60432 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab3d expref: 13 pid: 6581 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081703.251510:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796162944 00000100:00100000:3.0:1789081703.251516:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796162944 00000100:00100000:3.0:1789081703.251594:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 68 00000100:00100000:3.0:1789081703.251604:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+14:2351:x1875987796162944:12345-192.168.201.17@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789081703.252549:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 81 00000100:00100000:2.0:1789081703.252574:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41476931-e751-413e-b98c-64d4d0edcd05+14:2350:x1875987796162816:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789081703.252595:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789081703.252617:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fac1aed6/0xb7cb3d7479d60432 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab3d expref: 14 pid: 6581 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081703.252635:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fac1aed6/0xb7cb3d7479d60432 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab3d expref: 14 pid: 6581 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081703.252666:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fac1aed6/0xb7cb3d7479d60432 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab3d expref: 14 pid: 6581 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081703.252685:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789081703.252690:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789081703.252696:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005e6216b3/0xb7cb3d7479d60677 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081703.252707:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e6216b3/0xb7cb3d7479d60677 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081703.252739:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789081703.252819:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41476931-e751-413e-b98c-64d4d0edcd05+13:2350:x1875987796162816:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 249us (2110us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081703.252828:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 81 00010000:00010000:0.0:1789081703.253166:0:6581:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005e6216b3/0xb7cb3d7479d60677 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.253177:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e6216b3/0xb7cb3d7479d60677 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.253214:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e6216b3/0xb7cb3d7479d60677 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.253223:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e6216b3/0xb7cb3d7479d60677 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.253244:0:6581:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789081703.254039:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2def100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3305:x1875987821309696:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8177us (9144us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1789081703.254050:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:0.0:1789081703.254089:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789081703.254097:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e6216b3/0xb7cb3d7479d60677 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.254108:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101982600 already unused, calling callback (ffffffffc1784220) 00010000:00010000:0.0:1789081703.254114:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e6216b3/0xb7cb3d7479d60677 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.254124:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e6216b3/0xb7cb3d7479d60677 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.254146:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e6216b3/0xb7cb3d7479d60677 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.254155:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e6216b3/0xb7cb3d7479d60677 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.254189:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081703.254191:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081703.254193:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789081703.254254:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e11010b5500/2, rc 0, transno 4294967322 00000100:00100000:0.0:1789081703.254262:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821309696:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789081703.315330:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+12:2351:x1875987796162944:12345-192.168.201.17@tcp:16:lhsmtool_posix.0 Request processed in 63709us (64161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081703.315351:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 68 00000001:00080000:1.0:1789081703.316027:0:7493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:1.0:1789081703.316045:0:7493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:3.0:1789081703.319613:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081703.320026:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796163200 00000100:00100000:0.0:1789081703.320044:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796163200 00000100:00100000:0.0:1789081703.320135:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 228 00000100:00100000:0.0:1789081703.320148:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+20:11599:x1875987796163200:12345-192.168.201.17@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789081703.320575:0:9245:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789081703.320618:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d6065b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abd0 expref: 20 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.320644:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e10c7ecff00) 00010000:00010000:0.0:1789081703.320663:0:9245:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789081703.320706:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d6067e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.320722:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d6067e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.320735:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d6067e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789081703.321117:0:9245:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000075753b7c reply state 00000000b90da73d transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d6067e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081703.321129:0:9245:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789081703.322733:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+21:11599:x1875987796163200:12345-192.168.201.17@tcp:36:lhsmtool_posix.0 Request processed in 2050us (2599us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1789081703.322747:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 228 00000100:00100000:2.0:1789081703.327443:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081703.328116:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796163328 00000100:00100000:3.0:1789081703.328155:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796163328 00000100:00100000:3.0:1789081703.328419:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 69 00000100:00100000:3.0:1789081703.328433:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41476931-e751-413e-b98c-64d4d0edcd05+7:2349:x1875987796163328:12345-192.168.201.17@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789081703.328776:0:6582:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1789081703.328782:0:6582:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1789081703 -> 1789081701 00002000:00010000:3.0:1789081703.328784:0:6582:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789081701 00002000:00010000:3.0:1789081703.328787:0:6582:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789081703 -> 1789081701 00002000:00010000:3.0:1789081703.328790:0:6582:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789081703.328876:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41476931-e751-413e-b98c-64d4d0edcd05+8:2349:x1875987796163328:12345-192.168.201.17@tcp:2:lhsmtool_posix.0 Request processed in 446us (1449us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1789081703.328886:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 69 00010000:00010000:1.0:1789081703.332108:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d6067e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081703.332134:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d6067e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081703.332144:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d6067e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081703.332151:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101982600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081703.332201:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d6067e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081703.332212:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d6067e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081703.332236:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e10c7ecff00) 00010000:00010000:1.0:1789081703.332240:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789081703.332246:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d6067e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081703.332253:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d6067e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081703.333074:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081703.333333:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796163584 00000100:00100000:1.0:1789081703.333346:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796163584 00000100:00100000:1.0:1789081703.333586:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 229 00000100:00100000:1.0:1789081703.333598:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+20:11599:x1875987796163584:12345-192.168.201.17@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789081703.333702:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0200/0xb7cb3d7479d60685 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081703.333720:0:7252:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1600/0xb7cb3d7479d6063f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abc2 expref: 20 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081703.333730:0:7252:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0200/0xb7cb3d7479d60685 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081703.333774:0:7252:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1600/0xb7cb3d7479d6063f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abc2 expref: 20 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081703.333790:0:7252:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1600/0xb7cb3d7479d6063f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abc2 expref: 20 pid: 5790 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081703.333822:0:7252:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c7b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7252:1875987821310208:192.168.201.17@tcp:104: 00000100:00100000:1.0:1789081703.333949:0:7252:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d12f33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789081703.338436:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081703.338635:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796163712 00000100:00100000:2.0:1789081703.338647:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796163712 00010000:00010000:2.0:1789081703.338702:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1600/0xb7cb3d7479d6063f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abc2 expref: 21 pid: 5790 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081703.338774:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 82 00000100:00100000:2.0:1789081703.338784:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2defb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41476931-e751-413e-b98c-64d4d0edcd05+21:2350:x1875987796163712:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789081703.338807:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789081703.338816:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1600/0xb7cb3d7479d6063f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abc2 expref: 21 pid: 5790 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081703.338829:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1600/0xb7cb3d7479d6063f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abc2 expref: 21 pid: 5790 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081703.338858:0:7481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e10c7ecff00) 00010000:00010000:2.0:1789081703.338863:0:7481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0200/0xb7cb3d7479d60685 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081703.338874:0:7481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0200/0xb7cb3d7479d60685 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081703.338883:0:7481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0200/0xb7cb3d7479d60685 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081703.338906:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789081703.338983:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2defb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41476931-e751-413e-b98c-64d4d0edcd05+21:2350:x1875987796163712:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 200us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081703.338992:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 82 00010000:00010000:1.0:1789081703.339352:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1600/0xb7cb3d7479d6063f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abc2 expref: 20 pid: 5790 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081703.339374:0:7252:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c7b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7252:1875987821310208:192.168.201.17@tcp:104: 00010000:00010000:1.0:1789081703.339403:0:7252:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0200/0xb7cb3d7479d60685 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081703.339414:0:7252:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0200/0xb7cb3d7479d60685 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081703.339420:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0200/0xb7cb3d7479d60685 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081703.339461:0:7252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0200/0xb7cb3d7479d60685 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081703.339469:0:7252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0200/0xb7cb3d7479d60685 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081703.339476:0:7252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0200/0xb7cb3d7479d60685 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081703.339484:0:7252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10d1bd0200 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081703.339489:0:7252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0200/0xb7cb3d7479d60685 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081703.339512:0:7252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0200/0xb7cb3d7479d60685 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081703.339577:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e10c7ecff00) 00010000:00010000:1.0:1789081703.339581:0:7252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789081703.339586:0:7252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0200/0xb7cb3d7479d60685 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081703.339593:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0200/0xb7cb3d7479d60685 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081703.339665:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+19:11599:x1875987796163584:12345-192.168.201.17@tcp:55:lhsmtool_posix.0 Request processed in 6069us (6600us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789081703.339675:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 229 00000100:00100000:3.0:1789081703.347210:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081703.347431:0:7788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796163840 00000100:00100000:0.0:1789081703.347445:0:7788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796163840 00000100:00100000:0.0:1789081703.347588:0:7788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 70 00000100:00100000:0.0:1789081703.347601:0:7788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41476931-e751-413e-b98c-64d4d0edcd05+8:2351:x1875987796163840:12345-192.168.201.17@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789081703.347670:0:7788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000053f7e648/0xb7cb3d7479d6068c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.347696:0:7788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002c88e852/0xb7cb3d7479d60669 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abde expref: 8 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.347705:0:7788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789081703.347710:0:7788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789081703.347715:0:7788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053f7e648/0xb7cb3d7479d6068c lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.347760:0:7788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002c88e852/0xb7cb3d7479d60669 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abde expref: 8 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.347775:0:7788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002c88e852/0xb7cb3d7479d60669 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abde expref: 8 pid: 6582 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081703.347792:0:7788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff783480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7788:1875987821310336:192.168.201.17@tcp:104: 00000100:00100000:0.0:1789081703.347918:0:7788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c9167a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789081703.352671:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081703.352781:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796163968 00000100:00100000:1.0:1789081703.352794:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796163968 00010000:00010000:1.0:1789081703.352846:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002c88e852/0xb7cb3d7479d60669 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abde expref: 9 pid: 6582 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081703.352904:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 83 00000100:00100000:1.0:1789081703.352915:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41476931-e751-413e-b98c-64d4d0edcd05+9:2350:x1875987796163968:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789081703.352936:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789081703.352968:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002c88e852/0xb7cb3d7479d60669 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abde expref: 9 pid: 6582 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081703.352984:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002c88e852/0xb7cb3d7479d60669 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abde expref: 9 pid: 6582 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081703.353043:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789081703.353049:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789081703.353056:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000053f7e648/0xb7cb3d7479d6068c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081703.353068:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053f7e648/0xb7cb3d7479d6068c lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081703.353096:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789081703.353187:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41476931-e751-413e-b98c-64d4d0edcd05+9:2350:x1875987796163968:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 272us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081703.353204:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 83 00010000:00010000:0.0:1789081703.355440:0:7788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c88e852/0xb7cb3d7479d60669 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abde expref: 8 pid: 6582 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081703.355476:0:7788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff783480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7788:1875987821310336:192.168.201.17@tcp:104: 00010000:00010000:0.0:1789081703.355515:0:7788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000053f7e648/0xb7cb3d7479d6068c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.355590:0:7788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000053f7e648/0xb7cb3d7479d6068c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.355598:0:7788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053f7e648/0xb7cb3d7479d6068c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.355645:0:7788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000053f7e648/0xb7cb3d7479d6068c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.355653:0:7788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053f7e648/0xb7cb3d7479d6068c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.355662:0:7788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053f7e648/0xb7cb3d7479d6068c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.355669:0:7788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101983c00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:0.0:1789081703.355674:0:7788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053f7e648/0xb7cb3d7479d6068c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.355709:0:7788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053f7e648/0xb7cb3d7479d6068c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.355734:0:7788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053f7e648/0xb7cb3d7479d6068c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.355743:0:7788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053f7e648/0xb7cb3d7479d6068c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081703.355856:0:7788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41476931-e751-413e-b98c-64d4d0edcd05+7:2351:x1875987796163840:12345-192.168.201.17@tcp:1:lhsmtool_posix.0 Request processed in 8256us (8668us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081703.355867:0:7788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 70 00000100:00100000:2.0:1789081703.363059:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081703.363159:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796164224 00000100:00100000:0.0:1789081703.363180:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796164224 00000100:00100000:0.0:1789081703.363422:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 230 00000100:00100000:0.0:1789081703.363436:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+19:11599:x1875987796164224:12345-192.168.201.17@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789081703.363589:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d60693 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.363611:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d60693 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.363627:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d60693 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.363903:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d6069a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.363932:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d6064d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abc9 expref: 20 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.363943:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d6069a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.364119:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d6064d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abc9 expref: 20 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.364137:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d6064d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abc9 expref: 20 pid: 9245 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081703.364156:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff783480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5789:1875987821310464:192.168.201.17@tcp:104: 00000100:00100000:0.0:1789081703.364277:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c9167a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789081703.368951:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081703.369127:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796164352 00000100:00100000:3.0:1789081703.369141:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796164352 00010000:00010000:3.0:1789081703.369225:0:7481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d6064d lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abc9 expref: 21 pid: 9245 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081703.369281:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 84 00000100:00100000:3.0:1789081703.369293:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41476931-e751-413e-b98c-64d4d0edcd05+21:2351:x1875987796164352:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789081703.369316:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081703.369325:0:7481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d6064d lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abc9 expref: 21 pid: 9245 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081703.369344:0:7481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d6064d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abc9 expref: 21 pid: 9245 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081703.369412:0:7481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e10c7ecff00) 00010000:00010000:3.0:1789081703.369419:0:7481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d6069a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081703.369431:0:7481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d6069a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081703.369440:0:7481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d6069a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081703.369465:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789081703.369594:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41476931-e751-413e-b98c-64d4d0edcd05+21:2351:x1875987796164352:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 301us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081703.369604:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 84 00010000:00010000:0.0:1789081703.372654:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d6064d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abc9 expref: 20 pid: 9245 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081703.372692:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff783480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5789:1875987821310464:192.168.201.17@tcp:104: 00010000:00010000:0.0:1789081703.372732:0:5789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d6069a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.372744:0:5789:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d6069a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.372750:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d6069a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789081703.373850:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1789081703.377629:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:2.0:1789081703.377771:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1789081703.377892:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b2c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5789:1875987821310592:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789081703.378073:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081703.378124:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d106d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789081703.378490:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821310592 00000100:00100000:1.0:1789081703.378502:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821310592 00000100:00100000:1.0:1789081703.378813:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789081703.378825:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5789:x1875987821310592:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789081703.378945:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5789:x1875987821310592:12345-0@lo:1000:mdt00_000.0 Request processed in 122us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081703.378953:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789081703.379043:0:5789:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:2.0:1789081703.379050:0:5789:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:2.0:1789081703.379074:0:5789:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e10f96e0700, transno 4294967321 00000100:00100000:2.0:1789081703.379105:0:5789:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9e11010b5500 x1875987821309696/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789081719 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789081703.379119:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b2c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5789:1875987821310592:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1789081703.379757:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1789081703.379852:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b2c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5789:1875987821310720:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789081703.379916:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081703.381471:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d0c9e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789081703.381619:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821310720 00000100:00100000:0.0:1789081703.381630:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821310720 00000100:00100000:0.0:1789081703.381697:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789081703.381708:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5789:x1875987821310720:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789081703.382465:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5789:x1875987821310720:12345-0@lo:1000:mdt00_000.0 Request processed in 755us (2543us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1789081703.382477:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789081703.382698:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b2c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5789:1875987821310720:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1789081703.382766:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d6069a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081703.382778:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d6069a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081703.382787:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d6069a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081703.382794:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101983400 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081703.382799:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d6069a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081703.382809:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d6069a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081703.382854:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e10c7ecff00) 00010000:00010000:2.0:1789081703.382857:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789081703.382863:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d6069a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081703.382870:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d6069a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081703.382912:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d605dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081703.382919:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d605dd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081703.382924:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d605dd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081703.382929:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101775a00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081703.382932:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d605dd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081703.382954:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d605dd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081703.382963:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e10d046ff00) 00010000:00010000:2.0:1789081703.382965:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789081703.383689:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d605e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abad expref: 23 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081703.383707:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d605e4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abad expref: 23 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081703.383729:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d605e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abad expref: 23 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081703.383781:0:5789:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d605e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abad expref: 23 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081703.383799:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b2e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5789:1875987821310848:192.168.201.17@tcp:105: 00000100:00100000:2.0:1789081703.384001:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d0c9e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789081703.395055:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b2e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5789:1875987821310848:192.168.201.17@tcp:105: 00010000:00010000:0.0:1789081703.395102:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d605dd lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.395115:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d605dd lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.395162:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d606a1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.395199:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d606a1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.395214:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d606a1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.395228:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d606a1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.395235:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d606a1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.395242:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d606a1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.395829:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101982e00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081703.395835:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d606a1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.395844:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d606a1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.395860:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e10d046ff00) 00010000:00010000:0.0:1789081703.395864:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081703.395868:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d606a1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.395874:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982e00/0xb7cb3d7479d606a1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.395890:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d60693 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.395896:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d60693 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.395902:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d60693 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.395907:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101983c00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081703.395910:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d60693 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.395917:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d60693 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.395939:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e10d046ff00) 00010000:00010000:0.0:1789081703.395942:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789081703.395945:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d60693 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.395952:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d60693 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081703.396653:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+23:11599:x1875987796164224:12345-192.168.201.17@tcp:57:lhsmtool_posix.0 Request processed in 33212us (33600us total) trans 4294967513 rc 0/0 00000100:00100000:0.0:1789081703.396667:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 230 00000020:00080000:0.0:1789081703.396674:0:5789:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789081703.396939:0:11539:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789081703.396945:0:11539:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789081703.397777:0:11539:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1789081703.397795:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789081703.401690:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081703.401815:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796164480 00000100:00100000:0.0:1789081703.401828:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796164480 00000100:00100000:0.0:1789081703.401909:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 61 00000100:00100000:0.0:1789081703.401922:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101c30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+23:11598:x1875987796164480:12345-192.168.201.17@tcp:49:lfs.0 00000100:00100000:0.0:1789081703.402141:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101c30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+23:11598:x1875987796164480:12345-192.168.201.17@tcp:49:lfs.0 Request processed in 220us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081703.402149:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 61 00000100:00100000:2.0:1789081703.407879:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081703.408055:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081703.409217:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796164992 00000100:00100000:1.0:1789081703.409236:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796164992 00000100:00100000:1.0:1789081703.409339:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 231 00000100:00100000:1.0:1789081703.409382:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+23:11598:x1875987796164992:12345-192.168.201.17@tcp:58:lfs.0 00000040:00080000:1.0:1789081703.410905:0:9245:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1789081703.411310:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+23:11598:x1875987796164992:12345-192.168.201.17@tcp:58:lfs.0 Request processed in 1925us (3247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081703.411324:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 231 00000100:00100000:0.0:1789081703.411705:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796164736 00000100:00100000:0.0:1789081703.411717:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796164736 00000100:00100000:0.0:1789081703.411782:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 62 00000100:00100000:0.0:1789081703.411793:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d1b67450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+23:11599:x1875987796164736:12345-192.168.201.17@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789081703.414784:0:5793:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789081703.415065:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:0.0:1789081703.415325:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d606a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.415415:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d606a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.415432:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d606a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.415443:0:5793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d606a8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.415450:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d606a8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.415456:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d606a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081703.415612:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789081703.415759:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d1b67450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+25:11599:x1875987796164736:12345-192.168.201.17@tcp:35:lhsmtool_posix.0 Request processed in 3961us (7889us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1789081703.415772:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 62 00000020:00080000:0.0:1789081703.415779:0:5793:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789081703.421511:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789081703.421564:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d606a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081703.421578:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101983c00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:2.0:1789081703.421583:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d606a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081703.421594:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d606a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081703.421619:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e10c52f5300) 00010000:00010000:2.0:1789081703.421623:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789081703.421629:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d606a8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081703.421635:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d606a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081703.421699:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081703.421702:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081703.421704:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789081703.505666:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081703.505792:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796165120 00000100:00100000:1.0:1789081703.505806:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796165120 00000100:00100000:1.0:1789081703.505886:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 232 00000100:00100000:1.0:1789081703.505899:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+25:11601:x1875987796165120:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:1.0:1789081703.505936:0:7252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081703.505967:0:7252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1400/0xb7cb3d7479d606af lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2abe5 expref: -99 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081703.506060:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1600/0xb7cb3d7479d606b6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081703.506078:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1600/0xb7cb3d7479d606b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081703.506092:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1600/0xb7cb3d7479d606b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081703.506108:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0200/0xb7cb3d7479d606bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081703.506116:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0200/0xb7cb3d7479d606bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081703.506123:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0200/0xb7cb3d7479d606bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081703.506894:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1800/0xb7cb3d7479d606c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081703.506913:0:7252:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d605cf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aba6 expref: 26 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081703.506924:0:7252:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1800/0xb7cb3d7479d606c4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081703.506979:0:7252:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d605cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aba6 expref: 26 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081703.506997:0:7252:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d605cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aba6 expref: 26 pid: 5790 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081703.507014:0:7252:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c7b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7252:1875987821310976:192.168.201.17@tcp:104: 00000100:00100000:1.0:1789081703.507161:0:7252:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c923f780 going to sleep for 11 seconds 00000100:00100000:1.0:1789081703.516819:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081703.517181:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796165376 00000100:00100000:3.0:1789081703.517202:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796165376 00000100:00100000:3.0:1789081703.517276:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 63 00000100:00100000:3.0:1789081703.517289:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+27:5566:x1875987796165376:12345-192.168.201.17@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789081703.517707:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+28:5566:x1875987796165376:12345-192.168.201.17@tcp:35:ldlm_bl.0 Request processed in 419us (901us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1789081703.517715:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 63 00000100:00100000:2.0:1789081703.519629:0:7252:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c7b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7252:1875987821310976:192.168.201.17@tcp:104: 00010000:00010000:2.0:1789081703.519679:0:7252:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1800/0xb7cb3d7479d606c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081703.522918:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081703.523201:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796165504 00000100:00100000:1.0:1789081703.523215:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796165504 00010000:00010000:1.0:1789081703.523280:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d605cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aba6 expref: 28 pid: 5790 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081703.523333:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 85 00000100:00100000:1.0:1789081703.523344:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0f54c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41476931-e751-413e-b98c-64d4d0edcd05+28:2351:x1875987796165504:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789081703.523380:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789081703.523390:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d605cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aba6 expref: 28 pid: 5790 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081703.523424:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d605cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aba6 expref: 28 pid: 5790 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081703.523453:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d605cf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aba6 expref: 28 pid: 5790 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081703.523474:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e10d046ff00) 00010000:00010000:1.0:1789081703.523481:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1800/0xb7cb3d7479d606c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081703.523493:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1800/0xb7cb3d7479d606c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081703.523503:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1800/0xb7cb3d7479d606c4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081703.523613:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789081703.523684:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0f54c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41476931-e751-413e-b98c-64d4d0edcd05+27:2351:x1875987796165504:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 340us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081703.523692:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 85 00010000:00010000:3.0:1789081703.524278:0:7252:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1800/0xb7cb3d7479d606c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081703.524290:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1800/0xb7cb3d7479d606c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789081703.524359:0:7252:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789081703.524365:0:7252:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789081703.524402:0:7252:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1800/0xb7cb3d7479d606c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081703.524421:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1800/0xb7cb3d7479d606c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081703.524433:0:7252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1600/0xb7cb3d7479d606b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081703.524440:0:7252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1600/0xb7cb3d7479d606b6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081703.524447:0:7252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1600/0xb7cb3d7479d606b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081703.524453:0:7252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10d1bd1600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081703.524458:0:7252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1600/0xb7cb3d7479d606b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081703.524466:0:7252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1600/0xb7cb3d7479d606b6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081703.524478:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e10c7ecf100) 00010000:00010000:3.0:1789081703.524481:0:7252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081703.524485:0:7252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1600/0xb7cb3d7479d606b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081703.524492:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1600/0xb7cb3d7479d606b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081703.524517:0:7252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0200/0xb7cb3d7479d606bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081703.524569:0:7252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0200/0xb7cb3d7479d606bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081703.524576:0:7252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0200/0xb7cb3d7479d606bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081703.524581:0:7252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10d1bd0200 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081703.524584:0:7252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0200/0xb7cb3d7479d606bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081703.524590:0:7252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0200/0xb7cb3d7479d606bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081703.524599:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e10c7ecf400) 00010000:00010000:3.0:1789081703.524601:0:7252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081703.524605:0:7252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0200/0xb7cb3d7479d606bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081703.524610:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd0200/0xb7cb3d7479d606bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081703.524658:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1400/0xb7cb3d7479d606af lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abe5 expref: 27 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081703.524674:0:7252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1800/0xb7cb3d7479d606c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abe5 expref: 26 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081703.524692:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e10d046ff00) 00010000:00010000:3.0:1789081703.524695:0:7252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789081703.524697:0:7252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10d1bd1800, rc 0) 00000100:00100000:3.0:1789081703.524757:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+26:11601:x1875987796165120:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 18860us (19105us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081703.524766:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 232 00010000:00010000:3.0:1789081704.221974:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789081704.412810:0:11539:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789081704.412823:0:11539:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789081704.412867:0:11539:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789081704.412926:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789081704.413099:0:11539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c7b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11539:1875987821311104:192.168.201.17@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789081704.413296:0:11539:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c6682cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789081704.429135:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081704.429269:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796165632 00000100:00100000:1.0:1789081704.429282:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796165632 00000100:00100000:1.0:1789081704.429373:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 233 00000100:00100000:1.0:1789081704.429385:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d11ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+27:11612:x1875987796165632:12345-192.168.201.17@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789081704.429436:0:5789:0:(mdt_handler.c:8081:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789081704.429609:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d11ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+27:11612:x1875987796165632:12345-192.168.201.17@tcp:53:lhsmtool_posix.0 Request processed in 226us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081704.429618:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 233 00000100:00080000:1.0:1789081704.429645:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789081704.436493:0:11539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c7b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11539:1875987821311104:192.168.201.17@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789081704.438408:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081704.438494:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796165888 00000100:00100000:2.0:1789081704.438507:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796165888 00000100:00100000:2.0:1789081704.438615:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 234 00000100:00100000:2.0:1789081704.438627:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+26:11612:x1875987796165888:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789081704.438655:0:9245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081704.438685:0:9245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d606cb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2abec expref: -99 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081704.438822:0:9245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d606d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081704.438841:0:9245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d606d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081704.438856:0:9245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d606d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789081704.438871:0:9245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789081704.439051:0:9245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775c00/0xb7cb3d7479d606cb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abec expref: 29 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081704.439094:0:9245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d606d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abec expref: 28 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081704.439103:0:9245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e10d046ff00) 00010000:00010000:2.0:1789081704.439107:0:9245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789081704.439111:0:9245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101774400, rc 0) 00000100:00100000:2.0:1789081704.439192:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41476931-e751-413e-b98c-64d4d0edcd05+28:11612:x1875987796165888:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 567us (797us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1789081704.439200:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 234 00000100:00100000:1.0:1789081704.450208:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081704.450749:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796166016 00000100:00100000:3.0:1789081704.450765:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796166016 00000100:00100000:3.0:1789081704.450850:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 19 00000100:00100000:3.0:1789081704.450861:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41476931-e751-413e-b98c-64d4d0edcd05+28:2350:x1875987796166016:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789081704.450883:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081704.450919:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d606d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abec expref: 28 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081704.450943:0:7481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e10d046ff00) 00010000:00010000:3.0:1789081704.450949:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789081704.451020:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41476931-e751-413e-b98c-64d4d0edcd05+27:2350:x1875987796166016:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 161us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081704.451029:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 19 00000100:00100000:0.0:1789081704.458050:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081704.458178:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796166272 00000100:00100000:3.0:1789081704.458193:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796166272 00000100:00100000:3.0:1789081704.458271:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 235 00000100:00100000:3.0:1789081704.458282:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+27:11612:x1875987796166272:12345-192.168.201.17@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789081704.458403:0:7252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d606e0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081704.458442:0:7252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d606e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081704.458459:0:7252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d606e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081704.459028:0:7252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d606e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081704.459041:0:7252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d606e0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081704.459049:0:7252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d606e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081704.459056:0:7252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998800 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081704.459061:0:7252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d606e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081704.459070:0:7252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d606e0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081704.459086:0:7252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e10d046ff00) 00010000:00010000:2.0:1789081704.459089:0:7252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789081704.459094:0:7252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d606e0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081704.459109:0:7252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d606e0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7252 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081704.459355:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+28:11612:x1875987796166272:12345-192.168.201.17@tcp:57:lhsmtool_posix.0 Request processed in 1071us (1316us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1789081704.459365:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 235 00000040:00080000:0.0:1789081704.459940:0:11539:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789081704.459947:0:11539:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789081704.461109:0:11539:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789081704.461127:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789081704.464419:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081704.465637:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796166528 00000100:00100000:2.0:1789081704.465655:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796166528 00000100:00100000:2.0:1789081704.465734:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 64 00000100:00100000:2.0:1789081704.465746:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101c31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+28:11612:x1875987796166528:12345-192.168.201.17@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789081704.466075:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101c31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+29:11612:x1875987796166528:12345-192.168.201.17@tcp:35:lhsmtool_posix.0 Request processed in 329us (1665us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1789081704.466083:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 64 00000040:00080000:2.0:1789081704.679827:0:12363:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789081704.679842:0:12363:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789081704.679892:0:12363:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789081704.679900:0:12363:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789081704.915320:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081704.915597:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796166784 00000100:00100000:2.0:1789081704.915611:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796166784 00000100:00100000:2.0:1789081704.915695:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 236 00000100:00100000:2.0:1789081704.915708:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101c31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+29:11625:x1875987796166784:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:2.0:1789081704.915745:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081704.915775:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d606e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2abf3 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081704.915937:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d606ee lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081704.915975:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d606ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081704.915989:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d606ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789081704.916004:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789081704.916179:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d606e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abf3 expref: 32 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081704.916204:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d606ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abf3 expref: 31 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081704.916213:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e10d046ff00) 00010000:00010000:2.0:1789081704.916217:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789081704.916221:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101775000, rc 0) 00000100:00100000:2.0:1789081704.916312:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101c31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+31:11625:x1875987796166784:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 607us (1008us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1789081704.916321:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 236 00000100:00100000:0.0:1789081704.923118:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081704.923261:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796166912 00000100:00100000:3.0:1789081704.923276:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796166912 00000100:00100000:3.0:1789081704.923357:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 237 00000100:00100000:3.0:1789081704.923369:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+31:11625:x1875987796166912:12345-192.168.201.17@tcp:54:lfs.0 00010000:00010000:3.0:1789081704.923795:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d606fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081704.923900:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d606fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081704.923921:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d606fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081704.923967:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d606fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081704.923976:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d606fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081704.923984:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d606fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081704.923991:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081704.924016:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d606fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081704.924025:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d606fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081704.924040:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e10d046ff00) 00010000:00010000:3.0:1789081704.924044:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789081704.924050:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d606fc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081704.924057:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999600/0xb7cb3d7479d606fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081704.924247:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41476931-e751-413e-b98c-64d4d0edcd05+31:11625:x1875987796166912:12345-192.168.201.17@tcp:54:lfs.0 Request processed in 878us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081704.924257:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 237 00000100:00100000:3.0:1789081705.089100:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081705.089428:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796167040 00000100:00100000:0.0:1789081705.089462:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796167040 00000100:00100000:0.0:1789081705.089608:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 71 00000100:00100000:0.0:1789081705.089622:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101c30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41476931-e751-413e-b98c-64d4d0edcd05+7:2348:x1875987796167040:12345-192.168.201.17@tcp:101:cat.0 00010000:00010000:0.0:1789081705.089652:0:6582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081705.089694:0:6582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053f7e648/0xb7cb3d7479d60703 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2abfa expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789081705.089732:0:6582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aa33865, atime: 0x6aa33865, ctime: 0x6aa33865, blocks: 0xb 00010000:00010000:0.0:1789081705.089762:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=371s v=(0 0) 00010000:00010000:0.0:1789081705.089768:0:6582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789081705.089781:0:6582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053f7e648/0xb7cb3d7479d60703 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abfa expref: 8 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081705.089801:0:6582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000053f7e648/0xb7cb3d7479d60703 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abfa expref: 8 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081705.089817:0:6582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101983c00, rc 0) 00000100:00080000:1.0:1789081705.089945:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789081705.090574:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101c30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41476931-e751-413e-b98c-64d4d0edcd05+8:2348:x1875987796167040:12345-192.168.201.17@tcp:101:cat.0 Request processed in 954us (1491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081705.090585:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 71 00000100:00100000:1.0:1789081705.101255:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081705.101566:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796167168 00000100:00100000:3.0:1789081705.101584:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796167168 00002000:00100000:3.0:1789081705.101678:0:6587:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9e10d2defb80 x1875987796167168/t0(0) o3->41476931-e751-413e-b98c-64d4d0edcd05@192.168.201.17@tcp:496/0 lens 488/0 e 0 to 0 dl 1789081716 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789081705.101692:0:6587:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e10d2defb80 with x1875987796167168 ext(0->4095) 00002000:00010000:3.0:1789081705.101700:0:6587:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e10d2defb80 00000100:00100000:3.0:1789081705.101749:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 7 00000100:00100000:3.0:1789081705.101760:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2defb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41476931-e751-413e-b98c-64d4d0edcd05+8:2348:x1875987796167168:12345-192.168.201.17@tcp:3:cat.0 00000100:00100000:3.0:1789081705.102114:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2defb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41476931-e751-413e-b98c-64d4d0edcd05+8:2348:x1875987796167168:12345-192.168.201.17@tcp:3:cat.0 Request processed in 353us (874us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789081705.102122:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 7 00002000:00100000:3.0:1789081705.102137:0:6587:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9e10d2defb80 x1875987796167168/t0(0) o3->41476931-e751-413e-b98c-64d4d0edcd05@192.168.201.17@tcp:496/0 lens 488/4536 e 0 to 0 dl 1789081716 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789081705.102146:0:6587:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e10d2defb80 with x1875987796167168 ext(0->4095) 00002000:00010000:3.0:1789081705.102151:0:6587:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e10d2defb80 00010000:00010000:2.0:1789081705.247756:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789081705.389615:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1789081705.389644:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000040:00080000:0.0:1789081705.501001:0:11539:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789081705.501017:0:11539:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789081705.501060:0:11539:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789081705.501068:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789081706.268824:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789081706.333065:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789081706.334751:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821311232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789081706.334856:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081706.337111:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821311232 00000100:00100000:1.0:1789081706.337135:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821311232 00000100:00080000:1.0:1789081706.343790:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789081706.344476:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789081706.344506:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821311232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789081706.344616:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789081706.344730:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821311232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 241us (9873us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081706.344737:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789081706.344841:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1789081706.344848:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1789081706.344878:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e1101ad1c00, transno 4294967310 00000100:00100000:2.0:1789081706.344911:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821311232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789081706.845476:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789081706.845573:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f96e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821311360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789081706.845676:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081706.848762:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821311360 00000100:00100000:3.0:1789081706.848787:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821311360 00000100:00100000:3.0:1789081706.848895:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789081706.848908:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875987821311360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789081706.848962:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789081706.849077:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875987821311360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 173us (3401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081706.849085:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789081706.849212:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f96e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821311360:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789081706.849555:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789081706.850411:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875987821311872:0@lo:400:kworker.0 00000100:00100000:1.0:1789081706.850482:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081706.850570:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789081706.850576:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875987821311744:0@lo:400:kworker.0 00000100:00100000:1.0:1789081706.850602:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081706.850639:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821311872 00000100:00100000:1.0:1789081706.850646:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821311872 00000100:00100000:1.0:1789081706.850700:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821311744 00000100:00100000:1.0:1789081706.850703:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821311744 00000100:00100000:1.0:1789081706.850728:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789081706.850735:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875987821311872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081706.850892:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875987821311616:0@lo:400:kworker.0 00000100:00100000:0.0:1789081706.854627:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e1101ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee551687-7675-4fc6-9be1-2ccb62bdd809:3303:1875987821311488:0@lo:400:kworker.0 00000100:00100000:3.0:1789081706.860225:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081706.860377:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821311616 00000100:00100000:3.0:1789081706.860389:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821311616 00000100:00100000:3.0:1789081706.860445:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789081706.860458:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875987821311744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081706.860566:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875987821311744:12345-0@lo:400:kworker.0 Request processed in 111us (9960us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081706.860574:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789081706.860596:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789081706.860602:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f96e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875987821311616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081706.860638:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f96e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875987821311616:12345-0@lo:400:kworker.0 Request processed in 36us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081706.860662:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789081706.860714:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875987821311616:0@lo:400:kworker.0 00000100:00100000:0.0:1789081706.861056:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081706.861209:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875987821311872:12345-0@lo:400:kworker.0 Request processed in 10472us (10725us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081706.861227:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:1.0:1789081706.861294:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789081706.861329:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875987821311744:0@lo:400:kworker.0 00000100:00100000:1.0:1789081706.861345:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875987821311872:0@lo:400:kworker.0 00000100:00100000:3.0:1789081706.861481:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821311488 00000100:00100000:3.0:1789081706.861498:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821311488 00000100:00100000:3.0:1789081706.861571:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1789081706.861579:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3303:x1875987821311488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081706.861640:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3303:x1875987821311488:12345-0@lo:400:kworker.0 Request processed in 62us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081706.861650:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1789081706.861741:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e1101ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee551687-7675-4fc6-9be1-2ccb62bdd809:3303:1875987821311488:0@lo:400:kworker.0 00010000:00010000:2.0:1789081707.294605:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789081707.497046:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081707.497089:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081707.497141:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081707.497175:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081707.497202:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081707.497248:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796167424 00000100:00100000:1.0:1789081707.497263:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796167424 00000100:00100000:1.0:1789081707.497416:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796167808 00000100:00100000:1.0:1789081707.497420:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796167808 00000100:00100000:1.0:1789081707.497453:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 171 00000100:00100000:1.0:1789081707.497467:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+31:2348:x1875987796167424:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:1.0:1789081707.497692:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+31:2348:x1875987796167424:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 228us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081707.497702:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 171 00000100:00100000:1.0:1789081707.497721:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 172 00000100:00100000:1.0:1789081707.497727:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03f7db20-3934-4266-b84f-346a4ea22636+5:2348:x1875987796167808:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:1.0:1789081707.497757:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03f7db20-3934-4266-b84f-346a4ea22636+5:2348:x1875987796167808:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 31us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081707.497764:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 172 00000100:00080000:1.0:1789081707.497786:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789081707.499791:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796167680 00000100:00100000:0.0:1789081707.499811:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796167680 00000100:00100000:0.0:1789081707.499896:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796167552 00000100:00100000:0.0:1789081707.499901:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796167552 00000100:00100000:0.0:1789081707.499933:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 61 00000100:00100000:0.0:1789081707.499945:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+8:2348:x1875987796167680:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:0.0:1789081707.500032:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+8:2348:x1875987796167680:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 89us (2941us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081707.500041:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 61 00000100:00100000:0.0:1789081707.500058:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 62 00000100:00100000:0.0:1789081707.500066:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+5:2348:x1875987796167552:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:0.0:1789081707.500094:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+5:2348:x1875987796167552:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 29us (2918us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081707.500123:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 62 00000100:00080000:3.0:1789081707.501831:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789081707.501845:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789081707.504650:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796167296 00000100:00100000:2.0:1789081707.504673:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796167296 00000100:00100000:2.0:1789081707.504772:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 302 00000100:00100000:2.0:1789081707.504786:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2348:x1875987796167296:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:2.0:1789081707.504920:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2348:x1875987796167296:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 137us (7777us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081707.504930:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 302 00010000:00010000:3.0:1789081708.320481:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789081708.511136:0:5811:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967515 is committed 00000001:00080000:2.0:1789081708.511170:0:5811:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1789081708.511192:0:5811:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e10d106dd80 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1789081708.511198:0:5811:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e10ffb02200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e10d106d6c0 00000020:00080000:2.0:1789081708.511202:0:5811:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e10ffb02300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e10ff659400 00000020:00080000:2.0:1789081708.511231:0:5811:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1789081708.511499:0:5822:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1789081708.511712:0:5822:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:2.0:1789081708.516737:0:7493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:2.0:1789081708.516835:0:7493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00010000:00010000:2.0:1789081709.340670:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081710.376065:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789081711.276346:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081711.277314:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796167936 00000100:00100000:0.0:1789081711.277334:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796167936 00000100:00100000:0.0:1789081711.277458:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 238 00000100:00100000:0.0:1789081711.277474:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+18:11286:x1875987796167936:12345-192.168.201.17@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789081711.277672:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+18:11286:x1875987796167936:12345-192.168.201.17@tcp:60:lhsmtool_posix.0 Request processed in 203us (1340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081711.277681:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 238 00000100:00080000:3.0:1789081711.278627:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789081711.291146:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081711.292250:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796168192 00000100:00100000:2.0:1789081711.292270:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796168192 00000100:00100000:2.0:1789081711.292641:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 65 00000100:00100000:2.0:1789081711.292655:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+18:11286:x1875987796168192:12345-192.168.201.17@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789081711.296700:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+19:11286:x1875987796168192:12345-192.168.201.17@tcp:35:lhsmtool_posix.0 Request processed in 4030us (5551us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1789081711.296718:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 65 00010000:00010000:2.0:1789081711.388957:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789081711.453447:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821312000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789081711.453570:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081711.454036:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821312000 00000100:00100000:3.0:1789081711.454047:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821312000 00000100:00100000:3.0:1789081711.454134:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789081711.454145:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821312000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789081711.454206:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789081711.454621:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789081711.454807:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821312000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 662us (1235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081711.454818:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789081711.455385:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821312000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789081711.762241:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081711.763464:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796168320 00000100:00100000:1.0:1789081711.763482:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796168320 00000100:00100000:1.0:1789081711.763618:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 239 00000100:00100000:1.0:1789081711.763631:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03f7db20-3934-4266-b84f-346a4ea22636+5:12077:x1875987796168320:12345-192.168.201.17@tcp:101:lsof.0 00010000:00010000:1.0:1789081711.763662:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081711.763690:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1600/0xb7cb3d7479d6070a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ac01 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081711.763774:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1200/0xb7cb3d7479d60711 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081711.763791:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1200/0xb7cb3d7479d60711 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081711.763805:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1200/0xb7cb3d7479d60711 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789081711.764194:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1789081711.765582:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1789081711.765593:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1789081711.765703:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1200/0xb7cb3d7479d60711 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081711.765752:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1600/0xb7cb3d7479d6070a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ac01 expref: 7 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081711.765776:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1200/0xb7cb3d7479d60711 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ac01 expref: 6 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081711.765802:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c7ecf200) 00010000:00010000:1.0:1789081711.765806:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789081711.765810:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10d1bd1200, rc 0) 00000100:00100000:1.0:1789081711.767049:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03f7db20-3934-4266-b84f-346a4ea22636+6:12077:x1875987796168320:12345-192.168.201.17@tcp:101:lsof.0 Request processed in 3410us (4813us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081711.767063:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 239 00000100:00100000:3.0:1789081711.964990:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789081711.965023:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875987821312512:0@lo:400:kworker.0 00000100:00100000:1.0:1789081711.965023:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821312256:0@lo:400:kworker.0 00000100:00100000:0.0:1789081711.965123:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875987821312384:0@lo:400:kworker.0 00000100:00100000:2.0:1789081711.965279:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875987821312640:0@lo:400:kworker.0 00000100:00100000:1.0:1789081711.965974:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081711.966048:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821312768:0@lo:400:kworker.0 00000100:00100000:1.0:1789081711.966081:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081711.966085:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081711.966131:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821312256 00000100:00100000:0.0:1789081711.966131:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821312768 00000100:00100000:1.0:1789081711.966140:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821312256 00000100:00100000:0.0:1789081711.966140:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821312768 00000100:00100000:0.0:1789081711.966193:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789081711.966597:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1789081711.966607:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c50b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3305:x1875987821312256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081711.966669:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c50b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3305:x1875987821312256:12345-0@lo:400:kworker.0 Request processed in 64us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081711.966676:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1789081711.966968:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821312768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081711.967012:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821312768:12345-0@lo:400:kworker.0 Request processed in 54us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081711.967020:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789081711.967052:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821312384 00000100:00100000:0.0:1789081711.967058:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821312384 00000100:00100000:0.0:1789081711.967091:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789081711.967098:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875987821312384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081711.967135:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875987821312384:12345-0@lo:400:kworker.0 Request processed in 37us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081711.967141:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:0.0:1789081711.967192:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789081711.967434:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875987821312384:0@lo:400:kworker.0 00000100:00100000:0.0:1789081711.967545:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821312256:0@lo:400:kworker.0 00000100:00100000:0.0:1789081711.967558:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1789081711.967564:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e11010b5500, transno 4294967322 00000004:00080000:0.0:1789081711.967579:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:0.0:1789081711.967597:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821312768:0@lo:400:kworker.0 00000100:00100000:3.0:1789081711.967850:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081711.967897:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821312128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789081711.968389:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821312512 00000100:00100000:1.0:1789081711.968409:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821312512 00000100:00100000:1.0:1789081711.968545:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789081711.968556:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875987821312512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081711.968619:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875987821312512:12345-0@lo:400:kworker.0 Request processed in 65us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081711.968627:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789081711.968745:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081711.968800:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875987821312512:0@lo:400:kworker.0 00000100:00100000:2.0:1789081711.971803:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081711.972448:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821312128 00000100:00100000:1.0:1789081711.972461:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821312128 00000100:00100000:1.0:1789081711.972565:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789081711.972578:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821312128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789081711.972631:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789081711.972703:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821312128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (3957us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081711.972711:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789081711.972739:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821312640 00000100:00100000:1.0:1789081711.972743:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821312640 00000100:00100000:2.0:1789081711.972849:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821312128:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789081711.980954:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789081711.981371:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789081711.981391:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875987821312640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081711.981561:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875987821312640:12345-0@lo:400:kworker.0 Request processed in 177us (9768us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081711.981570:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789081711.981760:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875987821312640:0@lo:400:kworker.0 00010000:00010000:1.0:1789081712.414269:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789081712.600516:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081712.600731:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081712.600822:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081712.600859:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081712.600886:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081712.600963:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796168960 00000100:00100000:2.0:1789081712.600977:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796168960 00000100:00100000:2.0:1789081712.601046:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796168576 00000100:00100000:2.0:1789081712.601049:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796168576 00000100:00100000:2.0:1789081712.601073:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 176 00000100:00100000:2.0:1789081712.601082:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03f7db20-3934-4266-b84f-346a4ea22636+6:2348:x1875987796168960:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:2.0:1789081712.601185:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03f7db20-3934-4266-b84f-346a4ea22636+6:2348:x1875987796168960:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 104us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081712.601208:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 176 00000100:00100000:2.0:1789081712.601228:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 177 00000100:00100000:2.0:1789081712.601235:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+19:2348:x1875987796168576:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:2.0:1789081712.601273:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41476931-e751-413e-b98c-64d4d0edcd05+19:2348:x1875987796168576:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 38us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081712.601280:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 177 00000100:00100000:3.0:1789081712.603889:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796168448 00000100:00100000:3.0:1789081712.603910:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796168448 00000100:00100000:3.0:1789081712.604028:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 304 00000100:00100000:3.0:1789081712.604038:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2348:x1875987796168448:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081712.604146:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2348:x1875987796168448:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 108us (3644us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081712.604155:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 304 00000100:00100000:0.0:1789081712.622419:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796168704 00000100:00100000:0.0:1789081712.622440:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796168704 00000100:00100000:0.0:1789081712.622576:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796168832 00000100:00100000:0.0:1789081712.622580:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796168832 00000100:00100000:0.0:1789081712.622623:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 64 00000100:00100000:0.0:1789081712.622636:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41476931-e751-413e-b98c-64d4d0edcd05+5:2348:x1875987796168704:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:0.0:1789081712.622748:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41476931-e751-413e-b98c-64d4d0edcd05+5:2348:x1875987796168704:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 114us (22015us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081712.622757:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 64 00000100:00100000:0.0:1789081712.622777:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 65 00000100:00100000:0.0:1789081712.622784:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41476931-e751-413e-b98c-64d4d0edcd05+7:2348:x1875987796168832:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:0.0:1789081712.622812:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41476931-e751-413e-b98c-64d4d0edcd05+7:2348:x1875987796168832:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 29us (21924us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081712.622818:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 65 00000100:00080000:3.0:1789081712.624164:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789081712.624175:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789081713.436806:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789081713.616264:0:5811:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1789081713.616319:0:5822:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1789081713.616333:0:5822:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:2.0:1789081713.616352:0:5811:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00010000:00010000:1.0:1789081714.462393:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081715.486141:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789081715.741244:0:11539:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789081715.741259:0:11539:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789081715.741920:0:11539:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1789081715.741938:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789081716.514119:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789081716.606670:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff701c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821312896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789081716.606749:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081716.607136:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821312896 00000100:00100000:0.0:1789081716.607146:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821312896 00000100:00100000:0.0:1789081716.607227:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789081716.607238:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821312896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789081716.607276:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789081716.607336:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821312896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081716.607343:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789081716.607496:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff701c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821312896:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789081716.607907:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1789081716.890996:0:12567:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 19:08:34 (1789081714) 00000100:00100000:3.0:1789081717.085155:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875987821313280:0@lo:400:kworker.0 00000100:00100000:3.0:1789081717.085258:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081717.085344:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789081717.085351:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875987821313408:0@lo:400:kworker.0 00000100:00100000:3.0:1789081717.085375:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081717.085413:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821313280 00000100:00100000:3.0:1789081717.085420:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821313280 00000100:00100000:3.0:1789081717.085461:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821313408 00000100:00100000:3.0:1789081717.085464:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821313408 00000100:00100000:1.0:1789081717.085651:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821313152:0@lo:400:kworker.0 00000100:00100000:1.0:1789081717.085687:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081717.085735:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821313664:0@lo:400:kworker.0 00000100:00100000:1.0:1789081717.085759:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081717.085780:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789081717.085786:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff701c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821313024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789081717.085816:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081717.085833:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875987821313536:0@lo:400:kworker.0 00000100:00100000:1.0:1789081717.085854:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081717.085882:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821313536 00000100:00100000:1.0:1789081717.085886:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821313536 00000100:00100000:1.0:1789081717.085909:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789081717.085916:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875987821313280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081717.085970:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875987821313280:12345-0@lo:400:kworker.0 Request processed in 53us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081717.085977:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789081717.085997:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789081717.086003:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875987821313408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081717.086032:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875987821313408:12345-0@lo:400:kworker.0 Request processed in 30us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081717.086039:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789081717.086050:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789081717.086055:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875987821313536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081717.086087:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875987821313536:12345-0@lo:400:kworker.0 Request processed in 31us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081717.086094:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789081717.086112:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821313664 00000100:00100000:1.0:1789081717.086116:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821313664 00000100:00100000:1.0:1789081717.086146:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789081717.086152:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821313664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081717.086182:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821313664:12345-0@lo:400:kworker.0 Request processed in 30us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081717.086193:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789081717.086211:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821313024 00000100:00100000:1.0:1789081717.086215:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821313024 00000100:00100000:1.0:1789081717.086256:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789081717.086263:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821313024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789081717.086290:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789081717.086332:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821313024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081717.086338:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789081717.086386:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff701c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821313024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789081717.086396:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875987821313536:0@lo:400:kworker.0 00000100:00100000:1.0:1789081717.086404:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821313664:0@lo:400:kworker.0 00000100:00100000:1.0:1789081717.086440:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875987821313408:0@lo:400:kworker.0 00000100:00100000:1.0:1789081717.086450:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875987821313280:0@lo:400:kworker.0 00000100:00100000:0.0:1789081717.086556:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821313152 00000100:00100000:0.0:1789081717.086561:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821313152 00000100:00100000:0.0:1789081717.086589:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1789081717.086595:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ffa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3304:x1875987821313152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081717.086632:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ffa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3304:x1875987821313152:12345-0@lo:400:kworker.0 Request processed in 37us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081717.086639:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00080000:3.0:1789081717.086714:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789081717.086721:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789081717.087321:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821313152:0@lo:400:kworker.0 00010000:00010000:0.0:1789081717.533716:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081717.721982:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081717.722115:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081717.722161:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081717.722180:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796169344 00000100:00100000:3.0:1789081717.722195:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081717.722201:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796169344 00000100:00100000:3.0:1789081717.722233:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081717.722278:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796169472 00000100:00100000:3.0:1789081717.722287:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796169472 00000100:00100000:0.0:1789081717.722372:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796169088 00000100:00100000:0.0:1789081717.722379:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796169088 00000100:00100000:0.0:1789081717.722427:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 306 00000100:00100000:0.0:1789081717.722439:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2349:x1875987796169088:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:1.0:1789081717.722489:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 67 00000100:00100000:1.0:1789081717.722552:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+5:2349:x1875987796169344:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:0.0:1789081717.722577:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2349:x1875987796169088:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 141us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081717.722583:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+5:2349:x1875987796169344:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 78us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081717.722586:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 306 00000100:00100000:1.0:1789081717.722589:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 67 00000100:00100000:3.0:1789081717.722628:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 68 00000100:00100000:1.0:1789081717.722650:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796169600 00000100:00100000:3.0:1789081717.722656:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41476931-e751-413e-b98c-64d4d0edcd05+7:2349:x1875987796169472:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:1.0:1789081717.722657:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796169600 00000100:00100000:1.0:1789081717.722688:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796169216 00000100:00100000:1.0:1789081717.722692:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796169216 00000100:00100000:1.0:1789081717.722712:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 181 00000100:00100000:1.0:1789081717.722719:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03f7db20-3934-4266-b84f-346a4ea22636+6:2349:x1875987796169600:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:1.0:1789081717.722750:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03f7db20-3934-4266-b84f-346a4ea22636+6:2349:x1875987796169600:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 31us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081717.722755:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 181 00000100:00100000:1.0:1789081717.722767:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 182 00000100:00100000:1.0:1789081717.722773:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+18:2349:x1875987796169216:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:1.0:1789081717.722796:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+18:2349:x1875987796169216:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 23us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081717.722802:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 182 00000100:00080000:1.0:1789081717.722826:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789081717.722831:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789081717.722834:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789081717.722860:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41476931-e751-413e-b98c-64d4d0edcd05+7:2349:x1875987796169472:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 221us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081717.722869:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 68 00010000:00010000:1.0:1789081718.569378:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081719.580837:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081720.607369:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081721.634546:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789081721.692925:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10ff701c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821313792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789081721.693001:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081721.693180:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821313792 00000100:00100000:0.0:1789081721.693200:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821313792 00000100:00100000:0.0:1789081721.693275:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789081721.693285:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821313792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789081721.693320:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789081721.693375:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821313792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081721.693382:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1789081721.697786:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789081721.697860:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10ff701c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821313792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789081722.205849:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821314304:0@lo:400:kworker.0 00000100:00100000:3.0:1789081722.205923:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081722.205997:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789081722.206004:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821313920:0@lo:400:kworker.0 00000100:00100000:3.0:1789081722.206033:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081722.206057:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875987821314432:0@lo:400:kworker.0 00000100:00100000:3.0:1789081722.206081:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081722.206112:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821314432 00000100:00100000:3.0:1789081722.206120:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821314432 00000100:00100000:3.0:1789081722.206170:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789081722.206179:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875987821314432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081722.206261:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875987821314432:12345-0@lo:400:kworker.0 Request processed in 83us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081722.206285:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789081722.206329:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875987821314432:0@lo:400:kworker.0 00000100:00100000:2.0:1789081722.206555:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821314304 00000100:00100000:2.0:1789081722.206560:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821314304 00000100:00100000:2.0:1789081722.206598:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789081722.206605:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821314304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789081722.206648:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821314304:12345-0@lo:400:kworker.0 Request processed in 44us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081722.206655:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789081722.206681:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821314304:0@lo:400:kworker.0 00000100:00100000:1.0:1789081722.206790:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875987821314176:0@lo:400:kworker.0 00000100:00100000:1.0:1789081722.206820:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081722.206841:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789081722.206854:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875987821314048:0@lo:400:kworker.0 00000100:00100000:1.0:1789081722.206890:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081722.206907:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821314560:0@lo:400:kworker.0 00000100:00100000:1.0:1789081722.206928:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081722.206951:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821313920 00000100:00100000:1.0:1789081722.206956:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821313920 00000100:00100000:1.0:1789081722.206979:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1789081722.206986:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3305:x1875987821313920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081722.207020:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3305:x1875987821313920:12345-0@lo:400:kworker.0 Request processed in 34us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081722.207026:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1789081722.207052:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821314176 00000100:00100000:1.0:1789081722.207055:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821314176 00000100:00100000:1.0:1789081722.207078:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821314048 00000100:00100000:1.0:1789081722.207080:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821314048 00000100:00100000:1.0:1789081722.207095:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789081722.207101:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875987821314176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081722.207132:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875987821314176:12345-0@lo:400:kworker.0 Request processed in 31us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081722.207137:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789081722.207149:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789081722.207154:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10fada5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875987821314048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081722.207178:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10fada5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875987821314048:12345-0@lo:400:kworker.0 Request processed in 25us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081722.207184:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789081722.207207:0:7788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821314560 00000100:00100000:1.0:1789081722.207210:0:7788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821314560 00000100:00100000:1.0:1789081722.207253:0:7788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789081722.207260:0:7788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10fada7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821314560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081722.207291:0:7788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10fada7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821314560:12345-0@lo:400:kworker.0 Request processed in 32us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081722.207296:0:7788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1789081722.207316:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789081722.207321:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789081722.207384:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875987821314048:0@lo:400:kworker.0 00000100:00100000:1.0:1789081722.207394:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821314560:0@lo:400:kworker.0 00000100:00100000:1.0:1789081722.207402:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875987821314176:0@lo:400:kworker.0 00000100:00100000:1.0:1789081722.207425:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821313920:0@lo:400:kworker.0 00000100:00100000:0.0:1789081722.207760:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789081722.207771:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821314688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789081722.207803:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081722.207835:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821314688 00000100:00100000:0.0:1789081722.207839:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821314688 00000100:00100000:0.0:1789081722.207868:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789081722.207874:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff701c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821314688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789081722.207901:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789081722.207936:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff701c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821314688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081722.207942:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789081722.207975:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821314688:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789081722.653561:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789081722.842634:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081722.842806:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081722.842890:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796169856 00000100:00100000:3.0:1789081722.842900:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796169856 00000100:00100000:3.0:1789081722.842977:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 186 00000100:00100000:3.0:1789081722.842988:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10fada6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+18:2348:x1875987796169856:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081722.843068:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10fada6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41476931-e751-413e-b98c-64d4d0edcd05+18:2348:x1875987796169856:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 82us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081722.843076:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 186 00000100:00080000:1.0:1789081722.843298:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789081722.843607:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796169728 00000100:00100000:2.0:1789081722.843612:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796169728 00000100:00100000:2.0:1789081722.843685:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 308 00000100:00100000:2.0:1789081722.843693:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2348:x1875987796169728:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:2.0:1789081722.843736:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2348:x1875987796169728:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 44us (1212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081722.843743:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 308 00000100:00100000:1.0:1789081722.847380:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081722.847434:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081722.847511:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796170112 00000100:00100000:3.0:1789081722.847521:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796170112 00000100:00100000:3.0:1789081722.847621:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 71 00000100:00100000:3.0:1789081722.847632:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10fada4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+7:2349:x1875987796170112:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081722.847705:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10fada4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+7:2349:x1875987796170112:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 75us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081722.847713:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 71 00000100:00080000:1.0:1789081722.847912:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789081722.847963:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796170240 00000100:00100000:2.0:1789081722.847967:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796170240 00000100:00100000:2.0:1789081722.848021:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 187 00000100:00100000:2.0:1789081722.848029:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10fada5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03f7db20-3934-4266-b84f-346a4ea22636+6:2349:x1875987796170240:12345-192.168.201.17@tcp:400:kworker.0 00000100:00080000:1.0:1789081722.848118:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789081722.848184:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10fada5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03f7db20-3934-4266-b84f-346a4ea22636+6:2349:x1875987796170240:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 155us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081722.848218:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 187 00000100:00100000:1.0:1789081722.851814:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081722.851953:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796169984 00000100:00100000:3.0:1789081722.851964:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796169984 00000100:00100000:3.0:1789081722.852047:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 72 00000100:00100000:3.0:1789081722.852057:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10fada6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41476931-e751-413e-b98c-64d4d0edcd05+5:2347:x1875987796169984:12345-192.168.201.17@tcp:9:kworker.0 00000020:00000080:3.0:1789081722.852088:0:6581:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb7cb3d7479d5fa61 00000100:00080000:3.0:1789081722.852097:0:6581:0:(import.c:65:import_set_state_nolock()) ffff9e10f5c29000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789081722.852145:0:6581:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00080000:1.0:1789081722.852433:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789081722.852555:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081722.852910:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10fada6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41476931-e751-413e-b98c-64d4d0edcd05+2:2347:x1875987796169984:12345-192.168.201.17@tcp:9:kworker.0 Request processed in 853us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081722.852936:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 72 00000100:00100000:0.0:1789081723.099928:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081723.100054:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796170496 00000100:00100000:2.0:1789081723.100063:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796170496 00000100:00100000:2.0:1789081723.100118:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 66 00000100:00100000:2.0:1789081723.100127:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d16c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+18:12299:x1875987796170496:12345-192.168.201.17@tcp:35:umount.0 00000100:00100000:2.0:1789081723.100943:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d16c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+19:12299:x1875987796170496:12345-192.168.201.17@tcp:35:umount.0 Request processed in 814us (1021us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1789081723.100952:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 66 00000100:00100000:0.0:1789081723.111469:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081723.112693:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796170752 00000100:00100000:2.0:1789081723.112719:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796170752 00000100:00100000:2.0:1789081723.112802:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 67 00000100:00100000:2.0:1789081723.112821:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+19:12299:x1875987796170752:12345-192.168.201.17@tcp:35:umount.0 00000100:00100000:2.0:1789081723.113758:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41476931-e751-413e-b98c-64d4d0edcd05+20:12299:x1875987796170752:12345-192.168.201.17@tcp:35:umount.0 Request processed in 941us (2298us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1789081723.113769:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 67 00000100:00100000:3.0:1789081723.119027:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081723.119235:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796171008 00000100:00100000:1.0:1789081723.119249:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796171008 00000100:00100000:1.0:1789081723.119318:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 68 00000100:00100000:1.0:1789081723.119328:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5fdbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+20:12299:x1875987796171008:12345-192.168.201.17@tcp:35:umount.0 00000100:00100000:1.0:1789081723.119933:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5fdbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+21:12299:x1875987796171008:12345-192.168.201.17@tcp:35:umount.0 Request processed in 604us (918us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1789081723.119953:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 68 00000100:00100000:0.0:1789081723.123681:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081723.123973:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796171264 00000100:00100000:1.0:1789081723.123986:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796171264 00000100:00100000:1.0:1789081723.124205:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 69 00000100:00100000:1.0:1789081723.124221:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+21:12299:x1875987796171264:12345-192.168.201.17@tcp:35:umount.0 00000100:00100000:1.0:1789081723.124721:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41476931-e751-413e-b98c-64d4d0edcd05+22:12299:x1875987796171264:12345-192.168.201.17@tcp:35:umount.0 Request processed in 504us (1054us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1789081723.130551:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081723.130621:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081723.130649:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081723.130683:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796171392 00000100:00100000:0.0:1789081723.130702:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796171392 00000100:00100000:0.0:1789081723.130778:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796171648 00000100:00100000:0.0:1789081723.130781:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796171648 00000100:00100000:0.0:1789081723.130793:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796171520 00000100:00100000:0.0:1789081723.130795:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796171520 00000100:00100000:0.0:1789081723.130810:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 20 00000100:00100000:0.0:1789081723.130829:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+15:2348:x1875987796171392:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789081723.130848:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789081723.130875:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10c29e1e00/0xb7cb3d7479d5f789 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a78c expref: 15 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081723.130897:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789081723.130977:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+14:2348:x1875987796171392:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 149us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081723.130985:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 20 00000100:00100000:3.0:1789081723.131368:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 21 00000100:00100000:3.0:1789081723.131380:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+13:2348:x1875987796171648:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789081723.131388:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081723.131399:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e1101982800/0xb7cb3d7479d5f99d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a857 expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081723.131410:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789081723.131442:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+12:2348:x1875987796171648:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 67us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081723.131449:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 21 00000100:00100000:3.0:1789081723.131463:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 22 00000100:00100000:3.0:1789081723.131469:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+11:2348:x1875987796171520:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789081723.131476:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081723.131485:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10c1487a00/0xb7cb3d7479d5f6ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a754 expref: 11 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081723.131495:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789081723.131509:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:2348:x1875987796171520:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 41us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081723.131516:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 22 00000100:00100000:3.0:1789081723.136270:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081723.136413:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796172032 00000100:00100000:0.0:1789081723.136436:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796172032 00000100:00100000:0.0:1789081723.136508:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 73 00000100:00100000:0.0:1789081723.136519:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+7:2347:x1875987796172032:12345-192.168.201.17@tcp:9:umount.0 00000020:00000080:0.0:1789081723.136583:0:6584:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb7cb3d7479d5fcc2 00000020:00010000:0.0:1789081723.136592:0:6584:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9e10f958a800: total 0 00000100:00080000:0.0:1789081723.136598:0:6584:0:(import.c:65:import_set_state_nolock()) ffff9e10f9588800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789081723.136651:0:6584:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1789081723.136991:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41476931-e751-413e-b98c-64d4d0edcd05+5:2347:x1875987796172032:12345-192.168.201.17@tcp:9:umount.0 Request processed in 473us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081723.137000:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 73 00000020:00010000:0.0:1789081723.138652:0:5777:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9e10f958a800: total 0 00010000:00010000:0.0:1789081723.139420:0:5777:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e10f958a800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1789081723.140302:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053f7e648/0xb7cb3d7479d60703 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abfa expref: 4 pid: 6582 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081723.140362:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be9c5c2e/0xb7cb3d7479d60065 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa2c expref: 3 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081723.140379:0:5777:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e10f958a800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1789081723.140403:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081723.140405:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081723.140407:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789081723.140890:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 69 00000100:00100000:3.0:1789081723.167976:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081723.176886:0:7252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796173056 00000100:00100000:0.0:1789081723.176906:0:7252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796173056 00000100:00100000:0.0:1789081723.177009:0:7252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 240 00000100:00100000:0.0:1789081723.177021:0:7252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+22:2347:x1875987796173056:12345-192.168.201.17@tcp:39:umount.0 00000020:00000080:0.0:1789081723.177073:0:7252:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb7cb3d7479d5f6fd 00000020:00010000:0.0:1789081723.177095:0:7252:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9e0fc3a1e000: total 0 00000100:00080000:0.0:1789081723.177100:0:7252:0:(import.c:65:import_set_state_nolock()) ffff9e0fc3a1a000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789081723.177134:0:7252:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:2.0:1789081723.177968:0:5778:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9e0fc3a1e000: total 0 00010000:00010000:2.0:1789081723.177976:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081723.178053:0:5778:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e0fc3a1e000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1789081723.178104:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e10c9a92a00) 00010000:00010000:2.0:1789081723.178108:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789081723.178119:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775800/0xb7cb3d7479d5f9c7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a865 expref: 21 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081723.178304:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e10d19d3700) 00010000:00010000:2.0:1789081723.178315:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789081723.178352:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afa00/0xb7cb3d7479d60050 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa25 expref: 20 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081723.179808:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e10d046ff00) 00010000:00010000:2.0:1789081723.179817:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789081723.179827:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d606ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abf3 expref: 19 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081723.179866:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e10c7ecf100) 00010000:00010000:2.0:1789081723.179869:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789081723.179874:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d600e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa4f expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081723.179886:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e10c7ecf100) 00010000:00010000:2.0:1789081723.179888:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789081723.179892:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982000/0xb7cb3d7479d603c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ab21 expref: 17 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081723.179913:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e10d19d3700) 00010000:00010000:2.0:1789081723.179915:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789081723.179919:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982200/0xb7cb3d7479d5ff46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a9df expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081723.179933:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e10d19d3a00) 00010000:00010000:2.0:1789081723.179935:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789081723.179940:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982a00/0xb7cb3d7479d5fa37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a881 expref: 15 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081723.179958:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e10d046ff00) 00010000:00010000:2.0:1789081723.179976:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789081723.179982:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d605e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abad expref: 14 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081723.179999:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e10d19d3a00) 00010000:00010000:2.0:1789081723.180002:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789081723.180005:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983a00/0xb7cb3d7479d5fd24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a953 expref: 13 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081723.180023:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e10d046ff00) 00010000:00010000:2.0:1789081723.180026:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789081723.180031:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1800/0xb7cb3d7479d606c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2abe5 expref: 12 pid: 7252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081723.180064:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c7ecf200) 00010000:00010000:2.0:1789081723.180067:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789081723.180072:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d600c7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa48 expref: 11 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081723.180088:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e10d046fc00) 00010000:00010000:2.0:1789081723.180090:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081723.180093:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998a00/0xb7cb3d7479d5f9e3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a86c expref: 10 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081723.180106:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e10d19d3700) 00010000:00010000:2.0:1789081723.180108:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789081723.180111:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d60026 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aa17 expref: 9 pid: 9245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081723.180138:0:5778:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e0fc3a1e000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1789081723.180180:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081723.180184:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081723.180186:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789081723.183306:0:7252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41476931-e751-413e-b98c-64d4d0edcd05+7:2347:x1875987796173056:12345-192.168.201.17@tcp:39:umount.0 Request processed in 4680us (13737us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1789081723.183326:0:7252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 240 00010000:00010000:0.0:1789081723.683297:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789081723.841571:0:5811:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 41476931-e751-413e-b98c-64d4d0edcd05 00000001:00080000:0.0:1789081723.841591:0:5811:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1789081723.841609:0:5811:0:(genops.c:906:class_export_put()) final put ffff9e0fc3a1e000/41476931-e751-413e-b98c-64d4d0edcd05 00000020:00000080:0.0:1789081723.841634:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0fc3a1e000/41476931-e751-413e-b98c-64d4d0edcd05 for lustre-MDT0000 00000020:00000080:0.0:1789081723.841711:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e0fc3a1a000 for lustre-MDT0000 00000001:00100000:2.0:1789081723.856357:0:7493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 41476931-e751-413e-b98c-64d4d0edcd05 00000020:00000080:2.0:1789081723.856368:0:7493:0:(genops.c:906:class_export_put()) final put ffff9e10f958a800/41476931-e751-413e-b98c-64d4d0edcd05 00000020:00000080:0.0:1789081723.856814:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff9e10f958a800/41476931-e751-413e-b98c-64d4d0edcd05 for lustre-OST0001 00000020:00000080:0.0:1789081723.856878:0:491:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e10f9588800 for lustre-OST0001 00000100:00100000:0.0:1789081724.663509:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081724.663636:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081724.663875:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081724.663889:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796173184 00000100:00100000:3.0:1789081724.663910:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796173184 00000100:00100000:1.0:1789081724.664249:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796173440 00000100:00100000:1.0:1789081724.664254:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796173440 00000100:00100000:1.0:1789081724.664299:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 23 00000100:00100000:1.0:1789081724.664308:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+11:2351:x1875987796173184:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789081724.664324:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789081724.664343:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10e13ae400/0xb7cb3d7479d5f7cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a7a1 expref: 11 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081724.664360:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789081724.664413:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+10:2351:x1875987796173184:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 107us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081724.664421:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 23 00000100:00100000:1.0:1789081724.664438:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 24 00000100:00100000:1.0:1789081724.664444:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+9:2351:x1875987796173440:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789081724.664451:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789081724.664460:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e1101983e00/0xb7cb3d7479d5f996 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a850 expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081724.664482:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789081724.664498:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+8:2351:x1875987796173440:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 54us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081724.664504:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 24 00000100:00100000:2.0:1789081724.666644:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796173312 00000100:00100000:2.0:1789081724.666655:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796173312 00000100:00100000:2.0:1789081724.666710:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 25 00000100:00100000:2.0:1789081724.666717:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0f55450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+8:2351:x1875987796173312:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789081724.666730:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789081724.666744:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10c29e1600/0xb7cb3d7479d5f7d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a7cb expref: 8 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081724.666759:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789081724.666908:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0f55450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+7:2351:x1875987796173312:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 190us (3033us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081724.666916:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 25 00000100:00100000:0.0:1789081724.669662:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081724.670110:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796173696 00000100:00100000:1.0:1789081724.670127:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796173696 00000100:00100000:1.0:1789081724.670354:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 241 00000100:00100000:1.0:1789081724.670364:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03f7db20-3934-4266-b84f-346a4ea22636+6:2347:x1875987796173696:12345-192.168.201.17@tcp:39:umount.0 00000020:00000080:1.0:1789081724.670402:0:5790:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb7cb3d7479d5f7e4 00000020:00010000:1.0:1789081724.670409:0:5790:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9e10f98e6800: total 0 00000100:00080000:1.0:1789081724.670413:0:5790:0:(import.c:65:import_set_state_nolock()) ffff9e10f98e4800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789081724.670434:0:5790:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:1.0:1789081724.671073:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03f7db20-3934-4266-b84f-346a4ea22636+5:2347:x1875987796173696:12345-192.168.201.17@tcp:39:umount.0 Request processed in 710us (1418us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1789081724.671092:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 241 00000020:00010000:1.0:1789081724.671216:0:5778:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9e10f98e6800: total 0 00010000:00010000:1.0:1789081724.671256:0:5778:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e10f98e6800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789081724.671286:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c7ecf200) 00010000:00010000:1.0:1789081724.671290:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789081724.671297:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10d1bd1200/0xb7cb3d7479d60711 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ac01 expref: 4 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081724.671317:0:5778:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e10f98e6800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789081724.671326:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081724.671328:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081724.671330:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789081724.671570:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789081724.701753:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789081724.730447:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081724.730579:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796173952 00000100:00100000:2.0:1789081724.730590:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796173952 00000100:00100000:2.0:1789081724.730663:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 309 00000100:00100000:2.0:1789081724.730678:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+7:2347:x1875987796173952:12345-192.168.201.17@tcp:251:umount.0 00000020:00000080:2.0:1789081724.730730:0:5783:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb7cb3d7479d5f6da 00000020:00010000:2.0:1789081724.730739:0:5783:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9e10ff75b800: total 0 00000100:00080000:2.0:1789081724.730746:0:5783:0:(import.c:65:import_set_state_nolock()) ffff9e10ff75e800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789081724.730833:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc+3:2347:x1875987796173952:12345-192.168.201.17@tcp:251:umount.0 Request processed in 162us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081724.730855:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 309 00000020:00010000:3.0:1789081724.732048:0:5778:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9e10ff75b800: total 0 00010000:00010000:3.0:1789081724.732057:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081724.732103:0:5778:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e10ff75b800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789081724.732250:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10c1487c00/0xb7cb3d7479d5f790 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2a793 expref: 2 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081724.732267:0:5778:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e10ff75b800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1789081724.732278:0:5778:0:(genops.c:906:class_export_put()) final put ffff9e10ff75b800/33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc 00010000:00010000:3.0:1789081724.732332:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081724.732334:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081724.732336:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789081724.740137:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e10ff75b800/33229b0e-3c31-4bf8-83bb-cf3cc2c96fdc for MGS 00000020:00000080:1.0:1789081724.740214:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e10ff75e800 for MGS 00010000:00010000:1.0:1789081725.724693:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789081725.915361:0:6607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 41476931-e751-413e-b98c-64d4d0edcd05 00000020:00000080:1.0:1789081725.915701:0:6607:0:(genops.c:906:class_export_put()) final put ffff9e10f5c2f000/41476931-e751-413e-b98c-64d4d0edcd05 00000020:00000080:1.0:1789081725.915745:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e10f5c2f000/41476931-e751-413e-b98c-64d4d0edcd05 for lustre-OST0000 00000020:00000080:1.0:1789081725.915785:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e10f5c29000 for lustre-OST0000 00000040:00080000:1.0:1789081725.980856:0:11539:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789081725.980871:0:11539:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789081725.981475:0:11539:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1789081725.981488:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000020:01000004:1.0:1789081726.684966:0:12768:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1789081726.696645:0:12768:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1789081726.696694:0:12768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101998c00/0xb7cb3d7479d5f75f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f766 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081726.696720:0:12768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101998c00/0xb7cb3d7479d5f75f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f766 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081726.696728:0:12768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101998c00/0xb7cb3d7479d5f75f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xb7cb3d7479d5f766 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081726.696735:0:12768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.117@tcp lock: ffff9e1101998c00/0xb7cb3d7479d5f75f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xb7cb3d7479d5f766 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081726.696758:0:12768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789081726.696764:0:12768:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789081726.696787:0:12768:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789081726.696792:0:12768:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789081726.696797:0:12768:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789081726.696836:0:12768:0:(import.c:65:import_set_state_nolock()) ffff9e11010e9000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1789081726.697147:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789081726.697156:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e1101998c00/0xb7cb3d7479d5f75f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xb7cb3d7479d5f766 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081726.697165:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998c00 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:2.0:1789081726.697168:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e1101998c00/0xb7cb3d7479d5f75f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xb7cb3d7479d5f766 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081726.697178:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e1101998c00/0xb7cb3d7479d5f75f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xb7cb3d7479d5f766 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789081726.697184:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e1101998c00/0xb7cb3d7479d5f75f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xb7cb3d7479d5f766 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789081726.697190:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789081726.697193:0:5778:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789081726.697195:0:5778:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789081726.697223:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e1101998c00/0xb7cb3d7479d5f75f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb7cb3d7479d5f766 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081726.697229:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789081726.697258:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e1101998c00/0xb7cb3d7479d5f75f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb7cb3d7479d5f766 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081726.697265:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e1101998c00/0xb7cb3d7479d5f75f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb7cb3d7479d5f766 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081726.697282:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081726.697284:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081726.697293:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789081726.697624:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875987821314816:0@lo:39:umount.0 00000100:00100000:1.0:1789081726.697624:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821314944:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789081726.707037:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081726.707128:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821314816 00000100:00100000:2.0:1789081726.707147:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821314816 00000100:00100000:2.0:1789081726.707198:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1789081726.707206:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875987821314816:12345-0@lo:39:umount.0 00000020:00000080:2.0:1789081726.707238:0:5789:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb7cb3d7479d5f4e9 00000100:00080000:2.0:1789081726.707247:0:5789:0:(import.c:65:import_set_state_nolock()) ffff9e1101c75000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789081726.707319:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3302:x1875987821314816:12345-0@lo:39:umount.0 Request processed in 113us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081726.707326:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1789081726.707335:0:5789:0:(genops.c:906:class_export_put()) final put ffff9e1101c76000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:2.0:1789081726.707385:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e11010e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789081726.707395:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875987821314816:0@lo:39:umount.0 00000020:00000080:0.0:1789081726.708067:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff9e1101c76000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789081726.708118:0:491:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e1101c75000 for lustre-MDT0000 00010000:00010000:2.0:1789081726.710646:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789081726.710670:0:12768:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789081726.710675:0:12768:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789081726.710681:0:12768:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789081726.711950:0:12768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1200/0xb7cb3d7479d5f76d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f774 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081726.711969:0:12768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1200/0xb7cb3d7479d5f76d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f774 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081726.711977:0:12768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1200/0xb7cb3d7479d5f76d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xb7cb3d7479d5f774 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081726.711983:0:12768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1200/0xb7cb3d7479d5f76d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xb7cb3d7479d5f774 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081726.712011:0:12768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789081726.712025:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789081726.712031:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1200/0xb7cb3d7479d5f76d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xb7cb3d7479d5f774 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081726.712038:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10c29e1200 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:2.0:1789081726.712042:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1200/0xb7cb3d7479d5f76d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xb7cb3d7479d5f774 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081726.712050:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1200/0xb7cb3d7479d5f76d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xb7cb3d7479d5f774 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789081726.712057:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1200/0xb7cb3d7479d5f76d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xb7cb3d7479d5f774 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789081726.712064:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789081726.712067:0:5778:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00000100:00100000:1.0:1789081726.712075:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789081726.712102:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1200/0xb7cb3d7479d5f76d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xb7cb3d7479d5f774 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081726.712108:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789081726.712125:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1200/0xb7cb3d7479d5f76d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xb7cb3d7479d5f774 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081726.712132:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1200/0xb7cb3d7479d5f76d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xb7cb3d7479d5f774 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081726.712153:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081726.712155:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081726.712161:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789081726.712177:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821315072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789081726.712218:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789081726.712262:0:12768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c0030e00/0xb7cb3d7479d5f694 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f69b expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081726.712270:0:12768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c0030e00/0xb7cb3d7479d5f694 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f69b expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081726.712406:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821314944 00000100:00100000:1.0:1789081726.712414:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821314944 00000100:00100000:1.0:1789081726.712455:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821315072 00000100:00100000:1.0:1789081726.712458:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821315072 00000100:00100000:1.0:1789081726.712481:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789081726.712491:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10fada5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+20:3305:x1875987821314944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789081726.712504:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789081726.712519:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10c29e1000/0xb7cb3d7479d5f766 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb7cb3d7479d5f75f expref: 20 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081726.712550:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789081726.712581:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10fada5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+19:3305:x1875987821314944:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081726.712588:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789081726.712603:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789081726.712609:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+18:3306:x1875987821315072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789081726.712616:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789081726.712625:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e1101999a00/0xb7cb3d7479d5f774 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb7cb3d7479d5f76d expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081726.712634:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789081726.712660:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:3306:x1875987821315072:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081726.712666:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789081726.712705:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821315072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789081726.712740:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821314944:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789081726.714988:0:12768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c0030e00/0xb7cb3d7479d5f694 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb7cb3d7479d5f69b expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081726.714996:0:12768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.117@tcp lock: ffff9e10c0030e00/0xb7cb3d7479d5f694 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb7cb3d7479d5f69b expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081726.715020:0:12768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789081726.715035:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789081726.715041:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e10c0030e00/0xb7cb3d7479d5f694 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb7cb3d7479d5f69b expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081726.715049:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10c0030e00 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:2.0:1789081726.715053:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e10c0030e00/0xb7cb3d7479d5f694 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb7cb3d7479d5f69b expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081726.715063:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e10c0030e00/0xb7cb3d7479d5f694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb7cb3d7479d5f69b expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789081726.715070:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e10c0030e00/0xb7cb3d7479d5f694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb7cb3d7479d5f69b expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789081726.715095:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789081726.715097:0:5777:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789081726.715100:0:5777:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789081726.715132:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e10c0030e00/0xb7cb3d7479d5f694 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb7cb3d7479d5f69b expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081726.715149:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789081726.715176:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e10c0030e00/0xb7cb3d7479d5f694 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb7cb3d7479d5f69b expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081726.715184:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e10c0030e00/0xb7cb3d7479d5f694 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb7cb3d7479d5f69b expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081726.715201:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081726.715203:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081726.715204:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081726.715217:0:12768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101999800/0xb7cb3d7479d5f988 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f98f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081726.715225:0:12768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101999800/0xb7cb3d7479d5f988 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f98f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081726.715231:0:12768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101999800/0xb7cb3d7479d5f988 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb7cb3d7479d5f98f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081726.715236:0:12768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.117@tcp lock: ffff9e1101999800/0xb7cb3d7479d5f988 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb7cb3d7479d5f98f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081726.715248:0:12768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789081726.715263:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789081726.715267:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e1101999800/0xb7cb3d7479d5f988 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb7cb3d7479d5f98f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081726.716417:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789081726.716443:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821315200:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789081726.716504:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999800 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:2.0:1789081726.716509:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e1101999800/0xb7cb3d7479d5f988 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb7cb3d7479d5f98f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081726.716516:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789081726.716540:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e1101999800/0xb7cb3d7479d5f988 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb7cb3d7479d5f98f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789081726.716547:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e1101999800/0xb7cb3d7479d5f988 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb7cb3d7479d5f98f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789081726.716553:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789081726.716555:0:5778:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789081726.716558:0:5778:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789081726.716583:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e1101999800/0xb7cb3d7479d5f988 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb7cb3d7479d5f98f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081726.716590:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789081726.716604:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e1101999800/0xb7cb3d7479d5f988 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb7cb3d7479d5f98f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081726.716611:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e1101999800/0xb7cb3d7479d5f988 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb7cb3d7479d5f98f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081726.716707:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821315200 00000100:00100000:1.0:1789081726.716714:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821315200 00000100:00100000:1.0:1789081726.716762:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789081726.716771:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10fada6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+17:3304:x1875987821315200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789081726.716786:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789081726.716802:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10c0030200/0xb7cb3d7479d5f69b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb7cb3d7479d5f694 expref: 17 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081726.716818:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789081726.716845:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10fada6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:3304:x1875987821315200:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081726.716852:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789081726.716873:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821315328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789081726.716892:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081726.716916:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821315200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789081726.716937:0:7481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821315328 00000100:00100000:1.0:1789081726.716939:0:7481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821315328 00000100:00100000:1.0:1789081726.716960:0:7481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789081726.716965:0:7481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10fada5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee551687-7675-4fc6-9be1-2ccb62bdd809+16:3304:x1875987821315328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789081726.716972:0:7481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789081726.716981:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10e13af200/0xb7cb3d7479d5f98f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb7cb3d7479d5f988 expref: 16 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081726.717000:0:7481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789081726.717023:0:7481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10fada5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee551687-7675-4fc6-9be1-2ccb62bdd809+15:3304:x1875987821315328:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081726.717029:0:7481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1789081726.717344:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081726.717348:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081726.717349:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081726.717363:0:12768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae000/0xb7cb3d7479d5f448 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f44f expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081726.717732:0:12768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae000/0xb7cb3d7479d5f448 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f44f expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081726.717738:0:12768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae000/0xb7cb3d7479d5f448 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb7cb3d7479d5f44f expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081726.717744:0:12768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae000/0xb7cb3d7479d5f448 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb7cb3d7479d5f44f expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081726.717759:0:12768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789081726.717764:0:12768:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1789081726.717768:0:12768:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1789081726.717798:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789081726.717803:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae000/0xb7cb3d7479d5f448 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb7cb3d7479d5f44f expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081726.717811:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13ae000 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:2.0:1789081726.717814:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae000/0xb7cb3d7479d5f448 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb7cb3d7479d5f44f expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081726.717821:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae000/0xb7cb3d7479d5f448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb7cb3d7479d5f44f expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789081726.717827:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae000/0xb7cb3d7479d5f448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb7cb3d7479d5f44f expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789081726.717832:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789081726.717835:0:5777:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1789081726.717836:0:5777:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1789081726.717860:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae000/0xb7cb3d7479d5f448 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb7cb3d7479d5f44f expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081726.717866:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789081726.717883:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae000/0xb7cb3d7479d5f448 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb7cb3d7479d5f44f expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081726.718966:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae000/0xb7cb3d7479d5f448 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb7cb3d7479d5f44f expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081726.718987:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081726.718989:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081726.718991:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789081726.719012:0:12768:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1789081726.719016:0:12768:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1789081726.719021:0:12768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789081726.719027:0:12768:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:2.0:1789081726.719033:0:12768:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9e10f9787000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789081726.719038:0:12768:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9e10ff779800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789081726.719045:0:12768:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9e10f98e6800 03f7db20-3934-4266-b84f-346a4ea22636 192.168.201.17@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789081726.719050:0:12768:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9e1101c63380) has exports, disconnecting them 00000020:00080000:2.0:1789081726.719054:0:12768:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e10f9787000), last request at 1789081722 00000020:00000080:2.0:1789081726.719060:0:12768:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb7cb3d7479d5f65c 00000100:00080000:2.0:1789081726.719079:0:12768:0:(import.c:65:import_set_state_nolock()) ffff9e10f9781000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789081726.719167:0:12768:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e10f9787000): rc 0 00000020:00000080:2.0:1789081726.719170:0:12768:0:(genops.c:906:class_export_put()) final put ffff9e10f9787000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1789081726.719184:0:12768:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e10ff779800), last request at 1789081722 00000020:00000080:2.0:1789081726.719187:0:12768:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb7cb3d7479d5f591 00000100:00080000:2.0:1789081726.719192:0:12768:0:(import.c:65:import_set_state_nolock()) ffff9e10ff77f000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789081726.719217:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789081726.719225:0:12768:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e10ff779800): rc 0 00000020:00000080:2.0:1789081726.719227:0:12768:0:(genops.c:906:class_export_put()) final put ffff9e10ff779800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1789081726.719234:0:12768:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffadf200d87ae0 00000100:00080000:2.0:1789081726.719254:0:12768:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789081726.719258:0:12768:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00010000:00010000:3.0:1789081726.719543:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789081726.719696:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:3304:1875987821315328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789081726.719734:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789081726.719748:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821315456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789081726.719807:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081726.720788:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821315456 00000100:00100000:3.0:1789081726.720816:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821315456 00000100:00100000:3.0:1789081726.720900:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789081726.720909:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10fada7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+15:3306:x1875987821315456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789081726.720924:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00080000:2.0:1789081726.720930:0:12768:0:(osp_dev.c:1777:osp_import_event()) got inactive 00010000:00010000:3.0:1789081726.720943:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10c0031e00/0xb7cb3d7479d5f44f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb7cb3d7479d5f448 expref: 15 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081726.720992:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:2.0:1789081726.720996:0:12768:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1789081726.721018:0:12768:0:(import.c:65:import_set_state_nolock()) ffff9e10ffa8e800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1789081726.721037:0:12768:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789081726.721041:0:12768:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1789081726.721049:0:12768:0:(osp_dev.c:1777:osp_import_event()) got inactive 00000100:00100000:2.0:1789081726.721119:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875987821315584:0@lo:9:umount.0 00000100:00100000:2.0:1789081726.721169:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789081726.721210:0:12768:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1789081726.721222:0:12768:0:(import.c:65:import_set_state_nolock()) ffff9e0fc3a1a800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789081726.721241:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875987821315712:0@lo:9:umount.0 00000100:00100000:2.0:1789081726.721265:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1789081726.726038:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e10f9787000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789081726.726101:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e10ff779800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789081726.726128:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e10f9781000 for lustre-MDT0000 00000020:00000080:0.0:1789081726.726141:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e10ff77f000 for lustre-MDT0000 00000020:00080000:2.0:1789081726.726354:0:12768:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9e1101c63380) has no exports 00000100:00100000:0.0:1789081726.726732:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821315584 00000100:00100000:0.0:1789081726.726741:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821315584 00000100:00100000:0.0:1789081726.726796:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821315712 00000100:00100000:0.0:1789081726.726800:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821315712 00000100:00100000:0.0:1789081726.726832:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789081726.726842:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875987821315584:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789081726.726867:0:6582:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb7cb3d7479d5f5de 00000100:00080000:0.0:1789081726.726877:0:6582:0:(import.c:65:import_set_state_nolock()) ffff9e10ff759000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789081726.726921:0:6582:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1789081726.727293:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3302:x1875987821315584:12345-0@lo:9:umount.0 Request processed in 452us (6123us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081726.727301:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789081726.727317:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789081726.727337:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875987821315712:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789081726.727352:0:6582:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb7cb3d7479d5f6c5 00000100:00080000:0.0:1789081726.727357:0:6582:0:(import.c:65:import_set_state_nolock()) ffff9e0fc3a1b000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789081726.727376:0:6582:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1789081726.727574:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3302:x1875987821315712:12345-0@lo:9:umount.0 Request processed in 237us (6307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081726.727581:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1789081726.727604:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789081726.727608:0:5785:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789081726.727621:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789081726.730419:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789081726.730467:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:0:1875987821315840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789081726.731579:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10fada7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:3306:x1875987821315456:12345-0@lo:103:ldlm_bl.0 Request processed in 10667us (11767us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081726.731592:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:0.0:1789081726.737196:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789081726.737722:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821315456:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1789081726.737925:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e0fc3a1a800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789081726.737978:0:3302:0:(osp_dev.c:1761:osp_import_event()) got disconnected 00000004:00080000:0.0:1789081726.738051:0:3302:0:(osp_dev.c:1777:osp_import_event()) got inactive 00000100:00100000:0.0:1789081726.738057:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875987821315712:0@lo:9:umount.0 00000100:00080000:0.0:1789081726.738073:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e10ffa8e800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789081726.738083:0:3302:0:(osp_dev.c:1761:osp_import_event()) got disconnected 00000004:00080000:0.0:1789081726.738084:0:3302:0:(osp_dev.c:1777:osp_import_event()) got inactive 00000100:00100000:0.0:1789081726.738087:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875987821315584:0@lo:9:umount.0 00010000:00010000:0.0:1789081726.748851:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789081726.754028:0:12768:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9e1101c63380) has no exports 00000020:00000080:2.0:1789081726.881054:0:12768:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb7cb3d7479d5f4a3 00000020:00000080:2.0:1789081726.881071:0:12768:0:(genops.c:906:class_export_put()) final put ffff9e10f9562000/lustre-QMT0000_UUID 00000020:01000000:2.0:1789081726.881088:0:12768:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1789081726.881207:0:12768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789081726.881219:0:12768:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789081726.881224:0:12768:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9e10ee9b19c0) has no exports 00000020:00000080:0.0:1789081726.881261:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff9e10f9562000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1789081726.884102:0:12768:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb7cb3d7479d5f49c 00000020:00000080:3.0:1789081726.884116:0:12768:0:(genops.c:906:class_export_put()) final put ffff9e10fad3b800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789081726.884213:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff9e10fad3b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789081726.884228:0:12768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789081726.884240:0:12768:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789081726.884244:0:12768:0:(genops.c:906:class_export_put()) final put ffff9e10fad39800/lustre-QMT0000_UUID 00000020:00000080:3.0:1789081726.884246:0:12768:0:(genops.c:865:class_export_destroy()) destroying export ffff9e10fad39800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1789081726.884256:0:12768:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:3.0:1789081727.326170:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875987821316224:0@lo:400:kworker.0 00000100:00100000:3.0:1789081727.326260:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081727.326789:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee551687-7675-4fc6-9be1-2ccb62bdd809:3303:1875987821315968:0@lo:400:kworker.0 00000100:00100000:2.0:1789081727.326828:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081727.326849:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875987821316096:0@lo:400:kworker.0 00000100:00100000:2.0:1789081727.326873:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821315968 00000100:00100000:1.0:1789081727.326878:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081727.326893:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821315968 00000100:00100000:1.0:1789081727.326918:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821316224 00000100:00100000:1.0:1789081727.326922:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821316224 00000100:00100000:2.0:1789081727.326936:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1789081727.326944:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:3303:x1875987821315968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789081727.326993:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:3303:x1875987821315968:12345-0@lo:400:kworker.0 Request processed in 49us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081727.327000:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1789081727.327059:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee551687-7675-4fc6-9be1-2ccb62bdd809:3303:1875987821315968:0@lo:400:kworker.0 00000100:00100000:1.0:1789081727.327081:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821316096 00000100:00100000:1.0:1789081727.327085:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821316096 00000100:00100000:1.0:1789081727.327100:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789081727.327105:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3305:x1875987821316224:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789081727.327548:0:5790:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789081727.327587:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3305:x1875987821316224:12345-0@lo:400:kworker.0 Request processed in 480us (1326us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789081727.327619:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789081727.327625:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10fada7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3304:x1875987821316096:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1789081727.327630:0:9245:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00080000:3.0:1789081727.327645:0:3305:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789081727.327650:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9e1101618800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789081727.327654:0:3305:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1789081727.327660:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10fada7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3304:x1875987821316096:12345-0@lo:400:kworker.0 Request processed in 35us (782us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789081727.327666:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:2.0:1789081727.327692:0:3304:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789081727.327695:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9e10ffa8f800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789081727.327698:0:3304:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789081727.327702:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9e10ffa8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789081727.327706:0:3304:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 171 00000100:00080000:2.0:1789081727.327711:0:3304:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e10ffa8f800 using connection 192.168.201.117@tcp/0@lo 00000100:00100000:2.0:1789081727.327735:0:3304:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e10f9b2ce00 x1875987821316352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789081727.327753:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875987821316096:0@lo:400:kworker.0 00000100:00100000:2.0:1789081727.327796:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1875987821316352:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1789081727.327824:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081727.327863:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821316352 00000100:00100000:2.0:1789081727.327867:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821316352 00000100:00100000:2.0:1789081727.327893:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789081727.327898:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1875987821316352:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1789081727.327913:0:5791:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789081727.328075:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:3.0:1789081727.337899:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9e1101618800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789081727.337909:0:3305:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 192 00000100:00080000:3.0:1789081727.337918:0:3305:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e1101618800 using connection 192.168.201.117@tcp/0@lo 00000100:00100000:3.0:1789081727.338493:0:3305:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e10f5c03800 x1875987821316480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789081727.338564:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875987821316224:0@lo:400:kworker.0 00000100:00100000:0.0:1789081727.340636:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1875987821316480:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1789081727.340724:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081727.340823:0:9245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821316480 00000100:00100000:1.0:1789081727.340832:0:9245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821316480 00000100:00100000:1.0:1789081727.340877:0:9245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1789081727.340884:0:9245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3302:x1875987821316480:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1789081727.340914:0:9245:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789081727.340959:0:9245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3302:x1875987821316480:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 74us (234us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789081727.340966:0:9245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:3.0:1789081727.341873:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e1101618800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789081727.341880:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789081727.341884:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1875987821316480:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1789081727.369393:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1875987821316352:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 41484us (41558us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789081727.369407:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:3.0:1789081727.369588:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e10ffa8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789081727.369595:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789081727.369599:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1875987821316352:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:0.0:1789081727.772763:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081728.798086:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789081728.993881:0:7493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789081728.993890:0:7493:0:(genops.c:906:class_export_put()) final put ffff9e0fc3a1b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789081728.993930:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0fc3a1b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1789081728.994151:0:491:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e0fc3a1b000 for lustre-OST0001 00000001:00100000:0.0:1789081729.075014:0:5811:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 03f7db20-3934-4266-b84f-346a4ea22636 00000001:00080000:0.0:1789081729.075036:0:5811:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:0.0:1789081729.075057:0:5811:0:(genops.c:906:class_export_put()) final put ffff9e10f98e6800/03f7db20-3934-4266-b84f-346a4ea22636 00000020:00000080:1.0:1789081729.075200:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e10f98e6800/03f7db20-3934-4266-b84f-346a4ea22636 for lustre-MDT0000 00000020:00000080:1.0:1789081729.075272:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e10f98e4800 for lustre-MDT0000 00010000:00010000:0.0:1789081729.822507:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081730.844810:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789081731.047317:0:6607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789081731.047328:0:6607:0:(genops.c:906:class_export_put()) final put ffff9e10ff758000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789081731.048417:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e10ff758000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1789081731.048479:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e10ff759000 for lustre-OST0000 00010000:00010000:0.0:1789081731.869008:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789081732.451470:0:491:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789081732.451478:0:491:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789081732.451483:0:491:0:(import.c:65:import_set_state_nolock()) ffff9e10ffa8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789081732.451492:0:491:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 394 00000100:00080000:2.0:1789081732.451498:0:491:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789081732.451506:0:491:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e10ffa8f800 using connection 192.168.201.117@tcp/0@lo 00000100:00100000:2.0:1789081732.451569:0:491:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e10f9b2ce00 x1875987821316736/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789081732.451587:0:491:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789081732.451591:0:491:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789081732.451592:0:491:0:(import.c:65:import_set_state_nolock()) ffff9e1101618800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789081732.451596:0:491:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 394 00000100:00080000:2.0:1789081732.451599:0:491:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789081732.451603:0:491:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e1101618800 using connection 192.168.201.117@tcp/0@lo 00000100:00100000:2.0:1789081732.451637:0:491:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e10d2dc3800 x1875987821316864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789081732.451738:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789081732.451759:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821316608:0@lo:400:kworker.0 00000100:00100000:0.0:1789081732.451841:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081732.452362:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821316608 00000100:00100000:2.0:1789081732.452372:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821316608 00000100:00100000:2.0:1789081732.452435:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1789081732.452444:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c5ffb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:3305:x1875987821316608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789081732.452497:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c5ffb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee551687-7675-4fc6-9be1-2ccb62bdd809+14:3305:x1875987821316608:12345-0@lo:400:kworker.0 Request processed in 53us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081732.452503:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1789081732.452673:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee551687-7675-4fc6-9be1-2ccb62bdd809:3305:1875987821316608:0@lo:400:kworker.0 00000100:00100000:3.0:1789081732.454249:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1875987821316736:0@lo:38:kworker.0 00000100:00100000:3.0:1789081732.454313:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081732.454351:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1875987821316864:0@lo:38:kworker.0 00000100:00100000:3.0:1789081732.454374:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081732.454415:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821316736 00000100:00100000:3.0:1789081732.454422:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821316736 00000100:00100000:0.0:1789081732.454442:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821316864 00000100:00100000:0.0:1789081732.454446:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821316864 00000100:00100000:3.0:1789081732.454454:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789081732.454460:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1875987821316736:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1789081732.454478:0:5789:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789081732.470593:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1789081732.470607:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3302:x1875987821316864:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1789081732.470627:0:5790:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789081732.478241:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3302:x1875987821316864:12345-0@lo:38:kworker.0 Request processed in 7625us (23854us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789081732.478257:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00080000:1.0:1789081732.478599:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e1101618800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789081732.478605:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789081732.478609:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1875987821316864:0@lo:38:kworker.0 00000100:00100000:3.0:1789081732.490656:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1875987821316736:12345-0@lo:38:kworker.0 Request processed in 36183us (36331us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789081732.490672:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:1.0:1789081732.491177:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e10ffa8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789081732.491249:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789081732.491254:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1875987821316736:0@lo:38:kworker.0 00010000:00010000:0.0:1789081732.892800:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789081733.022196:0:12768:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e10ff5363c0 - data ffff9e10c2243a20/ffff9e10f5800000 00000020:01000000:0.0:1789081733.022328:0:12768:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e10c919e540 - data ffff9e10edbb60d8/ffff9e10fabc7c00 00000001:00000004:0.0:1789081733.032159:0:12768:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:0.0:1789081733.167116:0:12768:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789081733.167123:0:12768:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1789081733.167147:0:12768:0:(osp_dev.c:1777:osp_import_event()) got inactive 00000100:00100000:0.0:1789081733.167149:0:12768:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789081733.168699:0:6650:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789081733.168705:0:6650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:2.0:1789081733.168717:0:6650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1789081733.170200:0:12768:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789081733.170207:0:12768:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1789081733.170248:0:12768:0:(osp_dev.c:1777:osp_import_event()) got inactive 00000100:00100000:0.0:1789081733.170250:0:12768:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789081733.173789:0:7778:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789081733.173796:0:7778:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:3.0:1789081733.173807:0:7778:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1789081733.280315:0:12768:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb7cb3d7479d5f46b 00000020:00000080:0.0:1789081733.280334:0:12768:0:(genops.c:906:class_export_put()) final put ffff9e11010ee000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789081733.281511:0:12768:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb7cb3d7479d5f480 00000020:00000080:0.0:1789081733.281520:0:12768:0:(genops.c:906:class_export_put()) final put ffff9e1101c77000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789081733.281547:0:12768:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1789081733.281553:0:12768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789081733.281562:0:12768:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789081733.281565:0:12768:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9e10d1a019c0) has no exports 00000004:01000000:0.0:1789081733.281723:0:12768:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1789081733.281731:0:12768:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb7cb3d7479d5f6be 00000020:00000080:0.0:1789081733.281735:0:12768:0:(genops.c:906:class_export_put()) final put ffff9e0fc3a1d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789081733.281739:0:12768:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789081733.281743:0:12768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789081733.281749:0:12768:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789081733.281752:0:12768:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9e10ff7d4d40) has no exports 00000020:00000080:0.0:1789081733.281757:0:12768:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb7cb3d7479d5f6b7 00000020:00000080:0.0:1789081733.281760:0:12768:0:(genops.c:906:class_export_put()) final put ffff9e0fc3a18000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1789081733.282078:0:12768:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789081733.282082:0:12768:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789081733.282086:0:12768:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1789081733.282091:0:12768:0:(osp_dev.c:1777:osp_import_event()) got inactive 00000100:00100000:0.0:1789081733.282094:0:12768:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789081733.282122:0:12768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789081733.282129:0:12768:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789081733.282135:0:12768:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb7cb3d7479d5f5d7 00000020:00000080:0.0:1789081733.282139:0:12768:0:(genops.c:906:class_export_put()) final put ffff9e10ffa8a800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789081733.282142:0:12768:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789081733.282146:0:12768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789081733.282149:0:12768:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789081733.282151:0:12768:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9e10f9220000) has no exports 00000020:00000080:0.0:1789081733.282163:0:12768:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb7cb3d7479d5f5d0 00000020:00000080:0.0:1789081733.282166:0:12768:0:(genops.c:906:class_export_put()) final put ffff9e10ffa8d000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1789081733.282467:0:12768:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789081733.282470:0:12768:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789081733.282473:0:12768:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1789081733.282476:0:12768:0:(osp_dev.c:1777:osp_import_event()) got inactive 00000100:00100000:0.0:1789081733.282477:0:12768:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789081733.282498:0:12768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789081733.282503:0:12768:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789081733.282550:0:12768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789081733.282554:0:12768:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789081733.282578:0:12768:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb7cb3d7479d5f487 00000020:00000080:0.0:1789081733.282583:0:12768:0:(genops.c:906:class_export_put()) final put ffff9e1101c71800/lustre-MDD0000_UUID 00000020:01000000:0.0:1789081733.282588:0:12768:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1789081733.282592:0:12768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789081733.282595:0:12768:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789081733.282597:0:12768:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9e1101c64d40) has no exports 00000020:00000080:0.0:1789081733.282615:0:12768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789081733.282618:0:12768:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1789081733.282621:0:12768:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb7cb3d7479d5f48e 00000020:00000080:0.0:1789081733.282624:0:12768:0:(genops.c:906:class_export_put()) final put ffff9e1101c77800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789081733.282631:0:12768:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e10ee974800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1789081733.282634:0:12768:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e10ee974800 3 00000020:01000004:0.0:1789081733.282637:0:12768:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e10ee974800 from lustre-MDT0000 00000020:00000080:0.0:1789081733.282656:0:12768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789081733.282659:0:12768:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1789081733.282661:0:12768:0:(genops.c:906:class_export_put()) final put ffff9e11010ec800/lustre-MDT0000_UUID 00000020:00000080:0.0:1789081733.282664:0:12768:0:(genops.c:865:class_export_destroy()) destroying export ffff9e11010ec800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1789081733.282672:0:12768:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1789081733.282730:0:12768:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1789081733.282733:0:12768:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1789081733.282736:0:12768:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1789081733.282739:0:12768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789081733.282747:0:12768:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789081733.282754:0:12768:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9e10c510f000 ee551687-7675-4fc6-9be1-2ccb62bdd809 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789081733.282759:0:12768:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9e10d1a00000) has exports, disconnecting them 00000020:00080000:0.0:1789081733.282763:0:12768:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9e10c510f000), last request at 1789081483 00000020:00000080:0.0:1789081733.282777:0:12768:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb7cb3d7479d5f42c 00000020:00010000:0.0:1789081733.282781:0:12768:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9e10c510f000: total 8 00000100:00080000:0.0:1789081733.282785:0:12768:0:(import.c:65:import_set_state_nolock()) ffff9e10c510c800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789081733.282804:0:12768:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e10c510f000): rc 0 00000020:00080000:0.0:1789081733.282809:0:12768:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9e10d1a00000) has no exports 00000100:00100000:0.0:1789081733.282896:0:5782:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9e10c6047e00:5782] 0 exiting: rc = 1 00000020:00010000:3.0:1789081733.284227:0:5778:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9e10c510f000: total 8 00010000:00010000:3.0:1789081733.284274:0:5778:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e10c510f000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1789081733.284317:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e1101999c00/0xb7cb3d7479d5f973 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb7cb3d7479d5f96c expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081733.284345:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e1101999200/0xb7cb3d7479d5f758 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb7cb3d7479d5f751 expref: 8 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081733.284355:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e1102044e00/0xb7cb3d7479d5f544 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb7cb3d7479d5f53d expref: 7 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081733.284370:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10e13afc00/0xb7cb3d7479d5f782 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb7cb3d7479d5f77b expref: 6 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081733.284380:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10e13aea00/0xb7cb3d7479d5f981 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb7cb3d7479d5f97a expref: 5 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081733.284405:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10c29e1a00/0xb7cb3d7479d5f72e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb7cb3d7479d5f727 expref: 4 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081733.284415:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10e13af000/0xb7cb3d7479d5f74a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb7cb3d7479d5f743 expref: 3 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081733.284424:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10c29e0e00/0xb7cb3d7479d5f73c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb7cb3d7479d5f735 expref: 2 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081733.284436:0:5778:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e10c510f000, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1789081733.284448:0:5778:0:(genops.c:906:class_export_put()) final put ffff9e10c510f000/ee551687-7675-4fc6-9be1-2ccb62bdd809 00010000:00010000:3.0:1789081733.284457:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081733.284459:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081733.284461:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789081733.284761:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff9e11010ee000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789081733.284778:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff9e1101c77000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1789081733.284783:0:491:0:(genops.c:906:class_export_put()) final put ffff9e11010e8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789081733.284785:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff9e11010e8800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1789081733.284791:0:491:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789081733.284927:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0fc3a1d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1789081733.284933:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0fc3a18000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789081733.284938:0:491:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e0fc3a1a800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1789081733.284942:0:491:0:(genops.c:906:class_export_put()) final put ffff9e10f97ec000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789081733.284945:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff9e10f97ec000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1789081733.284949:0:491:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789081733.284973:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff9e10ffa8a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1789081733.284978:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff9e10ffa8d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789081733.284982:0:491:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e10ffa8e800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1789081733.284993:0:491:0:(genops.c:906:class_export_put()) final put ffff9e10ffa8a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789081733.284996:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff9e10ffa8a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1789081733.284998:0:491:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789081733.285075:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff9e1101c71800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1789081733.285079:0:491:0:(genops.c:906:class_export_put()) final put ffff9e10e452e800/lustre-MDD0000_UUID 00000020:00000080:2.0:1789081733.285081:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff9e10e452e800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1789081733.285085:0:491:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1789081733.285266:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff9e1101c77800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789081733.285271:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff9e10c510f000/ee551687-7675-4fc6-9be1-2ccb62bdd809 for MGS 00000020:00000080:2.0:1789081733.285421:0:491:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e10c510c800 for MGS 00000100:00100000:2.0:1789081733.285457:0:5783:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9e10c6046e00:5783] 1 exiting: rc = 0 00000100:00100000:2.0:1789081733.285555:0:5784:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9e10c6047400:5784] 2 exiting: rc = 0 00000100:00100000:3.0:1789081733.286251:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286259:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286264:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286270:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286275:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286295:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286301:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286307:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286312:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286329:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286335:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286340:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286345:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286350:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286355:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286360:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286365:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286383:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286391:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286396:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286402:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286408:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286413:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286419:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286427:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286432:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286437:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286442:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286447:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286452:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286458:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286463:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286468:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286474:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286478:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286483:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286487:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286492:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286496:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286502:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286507:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286513:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286517:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286548:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286555:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286560:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286566:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286571:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286576:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286582:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286587:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286592:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286604:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286609:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286614:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286619:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286624:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286629:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286634:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286639:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286645:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286650:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286655:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.286660:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1789081733.287056:0:12768:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789081733.287060:0:12768:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1789081733.291751:0:12768:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e10f5d90ba0 - data ffff9e10ffd39bd0/ffff9e1101845000 00000020:01000000:3.0:1789081733.291894:0:12768:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e10c9b40a80 - data ffff9e10edbb7510/ffff9e10d0fde800 00000020:00000080:3.0:1789081733.292363:0:12768:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb7cb3d7479d5f410 00000020:00000080:3.0:1789081733.292369:0:12768:0:(genops.c:906:class_export_put()) final put ffff9e10d1a0c000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1789081733.292388:0:12768:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e10ee974800 from MGS, refs=2 00000020:01000004:3.0:1789081733.292392:0:12768:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e10ee974800 2 00000020:01000004:3.0:1789081733.292395:0:12768:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e10ee974800 from MGS 00000020:00000080:3.0:1789081733.292416:0:12768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789081733.292422:0:12768:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1789081733.292425:0:12768:0:(genops.c:906:class_export_put()) final put ffff9e10d03d0800/MGS 00000020:00000080:3.0:1789081733.292427:0:12768:0:(genops.c:865:class_export_destroy()) destroying export ffff9e10d03d0800/MGS for MGS 00000020:01000000:3.0:1789081733.292433:0:12768:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1789081733.292486:0:12768:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1789081733.292490:0:12768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789081733.292495:0:12768:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789081733.292502:0:12768:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9e11010eb000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789081733.292508:0:12768:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff9e10f9690000) has exports, disconnecting them 00000020:00080000:3.0:1789081733.292512:0:12768:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9e11010eb000), last request at 1789081485 00000020:00000080:3.0:1789081733.292516:0:12768:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb7cb3d7479d5f4db 00000020:00080000:3.0:1789081733.292563:0:12768:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e11010eb000): rc 0 00000020:00000080:3.0:1789081733.292567:0:12768:0:(genops.c:906:class_export_put()) final put ffff9e11010eb000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789081733.293173:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff9e10d1a0c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789081733.293182:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff9e11010eb000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789081733.298073:0:12768:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789081733.298082:0:12768:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789081733.298087:0:12768:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789081733.298095:0:12768:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789081733.298126:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e11010e9000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789081733.298294:0:12768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789081733.298303:0:12768:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1789081733.298309:0:12768:0:(genops.c:906:class_export_put()) final put ffff9e10f9566800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1789081733.298312:0:12768:0:(genops.c:865:class_export_destroy()) destroying export ffff9e10f9566800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1789081733.298329:0:12768:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789081733.298392:0:12768:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e10ee974800 1 00000020:00000080:0.0:1789081733.298398:0:12768:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb7cb3d7479d5f402 00000020:00000080:0.0:1789081733.298414:0:12768:0:(genops.c:906:class_export_put()) final put ffff9e10d03d0000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789081733.298423:0:12768:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789081733.298432:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e10d03d0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789081733.298442:0:12768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789081733.298446:0:12768:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789081733.298450:0:12768:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9e10ee9b4d40) has no exports 00000020:00000080:3.0:1789081733.450771:0:12768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789081733.450787:0:12768:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1789081733.450793:0:12768:0:(genops.c:906:class_export_put()) final put ffff9e10ee976800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789081733.450797:0:12768:0:(genops.c:865:class_export_destroy()) destroying export ffff9e10ee976800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1789081733.450803:0:12768:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1789081733.450961:0:12768:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e10ee975000 00000020:01000000:3.0:1789081733.450983:0:12768:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1789081733.450987:0:12768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789081733.450991:0:12768:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789081733.450995:0:12768:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9e10d1a04d40) has no exports 00000100:00100000:3.0:1789081733.451094:0:5789:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9e10c922f000:5789] 0 exiting: rc = 1 00000100:00100000:0.0:1789081733.452309:0:5791:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9e10c922c600:5791] 2 exiting: rc = 0 00000100:00100000:0.0:1789081733.452392:0:5790:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9e10c922ce00:5790] 1 exiting: rc = 0 00000100:00100000:1.0:1789081733.458590:0:7252:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9e10c7ed0c00:7252] 3 exiting: rc = 0 00000100:00100000:2.0:1789081733.480979:0:9245:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9e10d1179000:9245] 4 exiting: rc = 0 00000100:00100000:0.0:1789081733.481245:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481253:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481258:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481263:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481267:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481272:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481278:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481293:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481308:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481323:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481330:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481338:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481343:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481348:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481354:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481359:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481364:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481368:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481373:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481378:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481383:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481388:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481394:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481399:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481415:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481419:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481426:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481431:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481436:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481441:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481447:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481451:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481456:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481460:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481465:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481483:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481488:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481493:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481513:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481520:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481551:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481556:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481561:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481566:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481570:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481575:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481580:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481585:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481590:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481594:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481599:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481604:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481609:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481614:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481619:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481627:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481632:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481638:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481643:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481648:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481654:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481659:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481664:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.481670:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.489298:0:5793:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9e10d11e3000:5793] 1 exiting: rc = 0 00000100:00100000:3.0:1789081733.495785:0:5792:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9e10c922da00:5792] 0 exiting: rc = 1 00000100:00100000:3.0:1789081733.508801:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.508825:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.508833:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.508840:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.508846:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.508865:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.508871:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.508877:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.508883:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.508888:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.508894:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.508899:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.508906:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.508912:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.508917:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.508921:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.508926:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.508931:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.508954:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.508959:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.508964:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.508968:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.508974:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.508980:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.508985:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.508990:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.508994:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.508999:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.509004:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.509011:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.509028:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.509033:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.509038:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.509042:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.509047:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.509052:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.509056:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.509061:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.509067:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.509072:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.509076:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.509081:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.509086:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.509090:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.509095:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.509100:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.509106:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.509111:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.509116:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.509121:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.509128:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.509132:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.509137:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.509150:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.509155:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.509160:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.509165:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.509170:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.509175:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.509180:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.509185:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.509190:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.509195:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.509210:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.509898:0:5794:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9e10d11f1800:5794] 0 exiting: rc = 1 00000100:00100000:3.0:1789081733.510778:0:5795:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9e10d11e3200:5795] 1 exiting: rc = 0 00000100:00100000:3.0:1789081733.510878:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.510887:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.510903:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.510909:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.510915:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.510921:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.510928:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.510934:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.510940:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.510945:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.510951:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.510965:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.510971:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.510977:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.510983:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.510988:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.510994:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511001:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511007:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511024:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511030:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511034:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511050:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511068:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511078:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511083:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511090:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511096:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511102:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511107:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511113:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511118:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511127:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511132:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511138:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511158:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511165:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511171:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511177:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511183:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511188:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511194:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511199:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511204:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511209:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511215:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511221:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511240:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511246:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511251:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511256:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511261:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511266:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511271:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511276:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511282:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511287:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511298:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511556:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511581:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511588:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511593:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511599:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.511611:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.552795:0:5797:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9e10d0aca400:5797] 1 exiting: rc = 0 00000100:00100000:0.0:1789081733.552986:0:5796:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9e10d11f1600:5796] 0 exiting: rc = 1 00000100:00100000:3.0:1789081733.557628:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.557639:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.557644:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.557649:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.557654:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.557658:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.557664:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.557668:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.557673:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.557677:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.557682:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.557687:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.557691:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.557696:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.557701:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.557706:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.557711:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.557716:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.557721:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.557725:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.557730:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.557735:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.557739:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.557744:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.557749:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.557754:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.557759:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.557786:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.557791:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.557796:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.557801:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.557806:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.559286:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.559471:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.559481:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.559486:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.559491:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.559497:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.559502:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.559507:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.559512:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.559517:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.559536:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.559544:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.559551:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.559556:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.559562:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.559567:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.559571:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.559575:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.559580:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.559585:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.559591:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.559595:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.559600:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.559605:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.559611:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.559615:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.559621:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.559626:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.559631:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.559636:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.559656:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.559661:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.561517:0:5798:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9e10eb31d400:5798] 0 exiting: rc = 1 00000100:00100000:0.0:1789081733.563380:0:5799:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9e10d0acb800:5799] 1 exiting: rc = 0 00000100:00100000:3.0:1789081733.564005:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564026:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564032:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564038:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564044:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564050:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564055:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564061:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564066:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564072:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564077:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564082:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564087:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564093:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564098:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564104:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564110:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564115:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564121:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564126:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564132:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564138:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564143:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564149:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564154:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564159:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564164:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564170:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564175:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564181:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564186:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564192:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564212:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564217:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564223:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564228:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564233:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564239:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564245:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564251:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564257:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564263:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564269:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564274:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564279:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564285:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564290:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564295:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564320:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564326:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564332:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564337:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564342:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564347:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564353:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564358:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564364:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564368:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564374:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564379:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564385:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564391:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564397:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.564899:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.565545:0:5800:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9e10eb31c000:5800] 0 exiting: rc = 1 00000100:00100000:3.0:1789081733.565657:0:5801:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9e10d0aca800:5801] 1 exiting: rc = 0 00000100:00100000:3.0:1789081733.565705:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.565712:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.565730:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.565736:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.565741:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.565746:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.565751:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.565757:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.565764:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.565769:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.565774:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.565780:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.565786:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.565791:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.565796:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.565801:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.565807:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.565812:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.565897:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.565903:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.565909:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.565914:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.565919:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.565924:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.565930:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.565934:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.565939:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.565944:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.565949:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.565954:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.565959:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.565963:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.565968:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.565973:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.565978:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.565983:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.565988:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.566000:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.566006:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.566022:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.566028:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.566033:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.566038:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.566043:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.566047:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.566051:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.566056:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.566061:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.566066:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.566070:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.566074:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.566078:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.566083:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.566087:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.566092:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.566096:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.566101:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.566106:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.566110:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.566114:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.566118:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.566123:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.566128:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081733.566133:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081733.569275:0:5803:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9e10e7c07e00:5803] 1 exiting: rc = 0 00000100:00100000:3.0:1789081733.571830:0:5802:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9e10eb31c200:5802] 0 exiting: rc = 1 00000100:00100000:1.0:1789081733.574938:0:5804:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9e10e7c3a400:5804] 2 exiting: rc = 0 00000100:00100000:2.0:1789081733.575688:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575698:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575704:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575710:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575719:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575726:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575733:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575739:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575746:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575752:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575759:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575765:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575771:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575778:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575784:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575802:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575831:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575837:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575843:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575849:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575853:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575860:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575866:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575871:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575877:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575883:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575889:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575894:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575900:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575906:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575911:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575916:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575922:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575928:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575935:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575940:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575946:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575951:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575957:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575978:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575984:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575989:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.575995:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.576000:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.576005:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.576010:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.576026:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.576032:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.576037:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.576043:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.576049:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.576063:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.576068:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.576074:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.576080:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.576086:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.576091:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.576096:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.576101:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.576106:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.576111:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.576116:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.576122:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081733.576127:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789081733.584493:0:12768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789081733.584505:0:12768:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1789081733.584511:0:12768:0:(genops.c:906:class_export_put()) final put ffff9e10d1a0a800/MDS_uuid 00000020:00000080:2.0:1789081733.584515:0:12768:0:(genops.c:865:class_export_destroy()) destroying export ffff9e10d1a0a800/MDS_uuid for MDS 00000020:01000000:2.0:1789081733.584547:0:12768:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1789081733.584700:0:12768:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1789081733.931598:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081734.941684:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081735.969415:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081736.990461:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789081737.060470:0:12923:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1789081737.072807:0:12923:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1789081737.072859:0:12923:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c1486c00/0xb7cb3d7479d5f743 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f74a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081737.072875:0:12923:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c1486c00/0xb7cb3d7479d5f743 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f74a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081737.072884:0:12923:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c1486c00/0xb7cb3d7479d5f743 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xb7cb3d7479d5f74a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081737.072892:0:12923:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.117@tcp lock: ffff9e10c1486c00/0xb7cb3d7479d5f743 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xb7cb3d7479d5f74a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081737.072930:0:12923:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789081737.072936:0:12923:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1789081737.072970:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789081737.072976:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e10c1486c00/0xb7cb3d7479d5f743 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xb7cb3d7479d5f74a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081737.072984:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10c1486c00 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:1.0:1789081737.072988:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e10c1486c00/0xb7cb3d7479d5f743 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xb7cb3d7479d5f74a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081737.073065:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e10c1486c00/0xb7cb3d7479d5f743 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xb7cb3d7479d5f74a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789081737.073073:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e10c1486c00/0xb7cb3d7479d5f743 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xb7cb3d7479d5f74a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789081737.073079:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789081737.073081:0:5777:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789081737.073084:0:5777:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789081737.073122:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e10c1486c00/0xb7cb3d7479d5f743 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xb7cb3d7479d5f74a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081737.073128:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789081737.073152:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e10c1486c00/0xb7cb3d7479d5f743 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xb7cb3d7479d5f74a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081737.073159:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e10c1486c00/0xb7cb3d7479d5f743 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xb7cb3d7479d5f74a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081737.073170:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081737.073177:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081737.073179:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789081737.073198:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee551687-7675-4fc6-9be1-2ccb62bdd809:3303:1875987821316992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789081737.073263:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081737.073295:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821316992 00000100:00100000:2.0:1789081737.073303:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821316992 00000100:00100000:2.0:1789081737.073346:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789081737.073353:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10fada4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3303:x1875987821316992:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789081737.073360:0:5775:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789081737 with bad export cookie 13243746699682640940 00000100:00080000:0.0:1789081737.075722:0:12923:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789081737.075741:0:12923:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789081737.075748:0:12923:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789081737.075764:0:12923:0:(import.c:65:import_set_state_nolock()) ffff9e10ffa8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1789081737.075770:0:12923:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789081737.075772:0:12923:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789081737.075775:0:12923:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789081737.078554:0:12923:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10e13af800/0xb7cb3d7479d5f751 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f758 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081737.079192:0:12923:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10e13af800/0xb7cb3d7479d5f751 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f758 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081737.079202:0:12923:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10e13af800/0xb7cb3d7479d5f751 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb7cb3d7479d5f758 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081737.079210:0:12923:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.117@tcp lock: ffff9e10e13af800/0xb7cb3d7479d5f751 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb7cb3d7479d5f758 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081737.079236:0:12923:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789081737.079245:0:12923:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101982c00/0xb7cb3d7479d5f97a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f981 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081737.079252:0:12923:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101982c00/0xb7cb3d7479d5f97a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f981 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081737.079258:0:12923:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101982c00/0xb7cb3d7479d5f97a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb7cb3d7479d5f981 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081737.079264:0:12923:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.117@tcp lock: ffff9e1101982c00/0xb7cb3d7479d5f97a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb7cb3d7479d5f981 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081737.079431:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789081737.079439:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e10e13af800/0xb7cb3d7479d5f751 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb7cb3d7479d5f758 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081737.079457:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13af800 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:3.0:1789081737.079461:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e10e13af800/0xb7cb3d7479d5f751 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb7cb3d7479d5f758 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081737.079470:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e10e13af800/0xb7cb3d7479d5f751 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xb7cb3d7479d5f758 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789081737.079476:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e10e13af800/0xb7cb3d7479d5f751 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xb7cb3d7479d5f758 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789081737.079481:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789081737.079483:0:5778:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:3.0:1789081737.079511:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e10e13af800/0xb7cb3d7479d5f751 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb7cb3d7479d5f758 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081737.079517:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789081737.079544:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e10e13af800/0xb7cb3d7479d5f751 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb7cb3d7479d5f758 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081737.079550:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e10e13af800/0xb7cb3d7479d5f751 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb7cb3d7479d5f758 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081737.079575:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081737.079577:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081737.079579:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789081737.079585:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10fada4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3303:x1875987821316992:12345-0@lo:103:ldlm_bl.0 Request processed in 6226us (6317us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789081737.079596:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:0.0:1789081737.079696:0:12923:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789081737.079701:0:12923:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:0.0:1789081737.079705:0:12923:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1789081737.079724:0:12923:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1789081737.079728:0:12923:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1789081737.079733:0:12923:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789081737.079738:0:12923:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789081737.079742:0:12923:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9e10ff7d0000) has no exports 00000020:00080000:0.0:1789081737.080080:0:12923:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9e10ff7d0000) has no exports 00010000:00010000:3.0:1789081737.081124:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789081737.081134:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e1101982c00/0xb7cb3d7479d5f97a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb7cb3d7479d5f981 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081737.081145:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101982c00 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:3.0:1789081737.081161:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e1101982c00/0xb7cb3d7479d5f97a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb7cb3d7479d5f981 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081737.081172:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e1101982c00/0xb7cb3d7479d5f97a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb7cb3d7479d5f981 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789081737.081180:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e1101982c00/0xb7cb3d7479d5f97a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb7cb3d7479d5f981 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789081737.081186:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789081737.081189:0:5777:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789081737.081191:0:5777:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789081737.081225:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e1101982c00/0xb7cb3d7479d5f97a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb7cb3d7479d5f981 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081737.081231:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789081737.081268:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e1101982c00/0xb7cb3d7479d5f97a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb7cb3d7479d5f981 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081737.081276:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e1101982c00/0xb7cb3d7479d5f97a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb7cb3d7479d5f981 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081737.081289:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081737.081291:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081737.081293:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081737.081303:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789081737.081319:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821317248:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789081737.081390:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081737.081441:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821317248 00000100:00100000:3.0:1789081737.081448:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821317248 00000100:00080000:1.0:1789081737.081577:0:3303:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.117@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789081737.081581:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e10d1a0d000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1789081737.081585:0:3303:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:3.0:1789081737.082126:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789081737.082144:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0f56c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3306:x1875987821317248:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789081737.082150:0:5774:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789081737 with bad export cookie 13243746699682640940 00000100:00100000:3.0:1789081737.082249:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0f56c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3306:x1875987821317248:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (857us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789081737.082257:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000020:01000000:0.0:1789081737.083644:0:12923:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e10d0fdbd80 - data ffff9e10f0145438/ffff9e10f5861400 00000020:01000000:0.0:1789081737.083810:0:12923:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e10c7db7420 - data ffff9e10d25716c0/ffff9e10ffa93c00 00000100:00080000:2.0:1789081737.084334:0:3306:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.117@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789081737.086770:0:3303:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.117@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1789081737.086776:0:3303:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1789081737.086787:0:3303:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e10fada5880 x1875987821316992/t0(0) o103->MGC192.168.201.117@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789081753 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789081737.086802:0:3303:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e10f5c00380 x1875987821317248/t0(0) o103->MGC192.168.201.117@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789081753 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789081737.087137:0:3306:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9e10d1a0d000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1789081737.087159:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee551687-7675-4fc6-9be1-2ccb62bdd809:3306:1875987821317248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789081737.087213:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee551687-7675-4fc6-9be1-2ccb62bdd809:0:1875987821317120:0@lo:103:ldlm_bl.0 10000000:01000000:1.0:1789081737.092409:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1789081737.092417:0:3303:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1789081737.092418:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1789081737.092423:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e10d1a0d000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789081737.092431:0:3303:0:(import.c:510:import_select_connection()) MGC192.168.201.117@tcp: connect to NID 0@lo last attempt 149 00000100:00080000:1.0:1789081737.092440:0:3303:0:(import.c:624:import_select_connection()) MGC192.168.201.117@tcp: import ffff9e10d1a0d000 using connection 192.168.201.117@tcp/0@lo 00000100:00100000:1.0:1789081737.092475:0:3303:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e10fada4e00 x1875987821317376/t0(0) o250->MGC192.168.201.117@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789081737.092519:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee551687-7675-4fc6-9be1-2ccb62bdd809:3303:1875987821316992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789081737.093618:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ee551687-7675-4fc6-9be1-2ccb62bdd809:3302:1875987821317376:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:3.0:1789081737.093672:0:3302:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875987821317376 offset 0 length 520: 4 00100000:10000000:0.0:1789081737.110000:0:12923:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789081737.167936:0:12923:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb7cb3d7479d5f560 00000020:00000080:0.0:1789081737.167946:0:12923:0:(genops.c:906:class_export_put()) final put ffff9e10ff7e2800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1789081737.167968:0:12923:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e10fad3e000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1789081737.167971:0:12923:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e10fad3e000 2 00000020:01000004:0.0:1789081737.167975:0:12923:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e10fad3e000 from lustre-OST0000 00000020:00000080:0.0:1789081737.167999:0:12923:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789081737.168009:0:12923:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1789081737.168012:0:12923:0:(genops.c:906:class_export_put()) final put ffff9e10d56b9800/lustre-OST0000_UUID 00000020:00000080:0.0:1789081737.168014:0:12923:0:(genops.c:865:class_export_destroy()) destroying export ffff9e10d56b9800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1789081737.168021:0:12923:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1789081737.168063:0:12923:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1789081737.168068:0:12923:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1789081737.168072:0:12923:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789081737.168076:0:12923:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789081737.168082:0:12923:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9e10ffa89800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789081737.168116:0:12923:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff9e1101c60000) has exports, disconnecting them 00000020:00080000:0.0:1789081737.168121:0:12923:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9e10ffa89800), last request at 1789081504 00000020:00000080:0.0:1789081737.168125:0:12923:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb7cb3d7479d5f58a 00000020:00080000:0.0:1789081737.168134:0:12923:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e10ffa89800): rc 0 00000020:00000080:0.0:1789081737.168138:0:12923:0:(genops.c:906:class_export_put()) final put ffff9e10ffa89800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789081737.171209:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e10ff7e2800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789081737.171234:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e10ffa89800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1789081737.175674:0:12923:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1789081737.175684:0:12923:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789081737.175688:0:12923:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789081737.175707:0:12923:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789081737.175998:0:12923:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789081737.176007:0:12923:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1789081737.176014:0:12923:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e10fad3e000 1 00000020:00000080:1.0:1789081737.176021:0:12923:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb7cb3d7479d5f51a 00000020:00000080:1.0:1789081737.176029:0:12923:0:(genops.c:906:class_export_put()) final put ffff9e10f958f800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1789081737.176054:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e10ffa8f800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789081737.176061:0:8:0:(genops.c:906:class_export_put()) final put ffff9e10ffa8d800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1789081737.176064:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e10ffa8d800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1789081737.176076:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1789081737.176176:0:12923:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1789081737.176181:0:12923:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789081737.176186:0:12923:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789081737.176189:0:12923:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9e10f9693380) has no exports 00000020:00000080:3.0:1789081737.176668:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e10f958f800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789081737.197235:0:12923:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789081737.197250:0:12923:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1789081737.197255:0:12923:0:(genops.c:906:class_export_put()) final put ffff9e10fad44000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1789081737.197259:0:12923:0:(genops.c:865:class_export_destroy()) destroying export ffff9e10fad44000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1789081737.197271:0:12923:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1789081737.197423:0:12923:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e10fad46000 00000020:02000400:3.0:1789081737.197468:0:12923:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:1.0:1789081737.567188:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ee551687-7675-4fc6-9be1-2ccb62bdd809->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789081737.567198:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ee551687-7675-4fc6-9be1-2ccb62bdd809->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789081737.567201:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789081737.567205:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789081737.567209:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e1101618800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789081737.567216:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 399 00000100:00080000:1.0:1789081737.567221:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789081737.567228:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e1101618800 using connection 192.168.201.117@tcp/0@lo 00000100:00100000:1.0:1789081737.567264:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e10fada5880 x1875987821317504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789081737.567456:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1875987821317504:0@lo:38:kworker.0 00000400:00000100:1.0:1789081737.567511:0:3302:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875987821317504 offset 0 length 520: 4 00010000:00010000:3.0:1789081738.013824:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081739.037746:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081740.061648:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789081740.547413:0:13073:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1789081740.572297:0:13073:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1789081740.572378:0:13073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae800/0xb7cb3d7479d5f727 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f72e expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081740.572393:0:13073:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae800/0xb7cb3d7479d5f727 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f72e expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081740.572401:0:13073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae800/0xb7cb3d7479d5f727 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb7cb3d7479d5f72e expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081740.572409:0:13073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae800/0xb7cb3d7479d5f727 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb7cb3d7479d5f72e expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081740.572432:0:13073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789081740.572437:0:13073:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789081740.572459:0:13073:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789081740.572469:0:13073:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e10fada5880 x1875987821317504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789081757 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081740.572486:0:13073:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789081740.572491:0:13073:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789081740.572497:0:13073:0:(import.c:65:import_set_state_nolock()) ffff9e1101618800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789081740.572502:0:13073:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789081740.572520:0:13073:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e10fada5880 x1875987821317504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789081757 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081740.572548:0:13073:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789081740.572551:0:13073:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00010000:00010000:3.0:1789081740.572787:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789081740.572794:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae800/0xb7cb3d7479d5f727 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb7cb3d7479d5f72e expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081740.572802:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13ae800 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:3.0:1789081740.572806:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae800/0xb7cb3d7479d5f727 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb7cb3d7479d5f72e expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081740.572827:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae800/0xb7cb3d7479d5f727 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb7cb3d7479d5f72e expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789081740.572833:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae800/0xb7cb3d7479d5f727 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb7cb3d7479d5f72e expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789081740.572839:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789081740.572842:0:5777:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789081740.572844:0:5777:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789081740.572857:0:5777:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e10d1a0d000 00010000:00010000:3.0:1789081740.572861:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae800/0xb7cb3d7479d5f727 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb7cb3d7479d5f72e expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081740.572867:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae800/0xb7cb3d7479d5f727 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb7cb3d7479d5f72e expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081740.572876:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081740.572878:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081740.572880:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789081740.573855:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1875987821317504:0@lo:38:kworker.0 00010000:00010000:0.0:1789081740.579824:0:13073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c1486000/0xb7cb3d7479d5f735 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f73c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081740.579846:0:13073:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c1486000/0xb7cb3d7479d5f735 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f73c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081740.579853:0:13073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c1486000/0xb7cb3d7479d5f735 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb7cb3d7479d5f73c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081740.579860:0:13073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.117@tcp lock: ffff9e10c1486000/0xb7cb3d7479d5f735 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb7cb3d7479d5f73c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081740.579900:0:13073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789081740.579908:0:13073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101983200/0xb7cb3d7479d5f96c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d5f973 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081740.579914:0:13073:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101983200/0xb7cb3d7479d5f96c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d5f973 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081740.579919:0:13073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101983200/0xb7cb3d7479d5f96c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb7cb3d7479d5f973 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081740.579925:0:13073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.117@tcp lock: ffff9e1101983200/0xb7cb3d7479d5f96c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb7cb3d7479d5f973 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081740.579991:0:13073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1789081740.580013:0:13073:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1789081740.580034:0:13073:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1789081740.580039:0:13073:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1789081740.580044:0:13073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789081740.580050:0:13073:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789081740.580054:0:13073:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9e10f9694d40) has no exports 00000020:00080000:0.0:1789081740.580080:0:13073:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9e10f9694d40) has no exports 00010000:00010000:2.0:1789081740.582797:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789081740.582831:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e10c1486000/0xb7cb3d7479d5f735 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb7cb3d7479d5f73c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081740.582842:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10c1486000 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:2.0:1789081740.582846:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e10c1486000/0xb7cb3d7479d5f735 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb7cb3d7479d5f73c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081740.582857:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e10c1486000/0xb7cb3d7479d5f735 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb7cb3d7479d5f73c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789081740.582863:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e10c1486000/0xb7cb3d7479d5f735 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb7cb3d7479d5f73c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789081740.582869:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789081740.582871:0:5777:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1789081740.582874:0:5777:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1789081740.582901:0:5777:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e10d1a0d000 00010000:00010000:2.0:1789081740.582906:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e10c1486000/0xb7cb3d7479d5f735 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb7cb3d7479d5f73c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081740.582912:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e10c1486000/0xb7cb3d7479d5f735 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb7cb3d7479d5f73c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081740.582928:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789081740.582931:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e1101983200/0xb7cb3d7479d5f96c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb7cb3d7479d5f973 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081740.582937:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101983200 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:2.0:1789081740.582939:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e1101983200/0xb7cb3d7479d5f96c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb7cb3d7479d5f973 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081740.582955:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e1101983200/0xb7cb3d7479d5f96c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb7cb3d7479d5f973 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789081740.582961:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e1101983200/0xb7cb3d7479d5f96c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb7cb3d7479d5f973 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789081740.582966:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789081740.582968:0:5777:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789081740.582970:0:5777:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789081740.582975:0:5777:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e10d1a0d000 00010000:00010000:2.0:1789081740.582978:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e1101983200/0xb7cb3d7479d5f96c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb7cb3d7479d5f973 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081740.582983:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e1101983200/0xb7cb3d7479d5f96c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb7cb3d7479d5f973 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081740.582994:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081740.582996:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081740.582997:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789081740.583371:0:13073:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e10d0fdb240 - data ffff9e10edb10af8/ffff9e10ff59c400 00010000:00010000:3.0:1789081740.583816:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789081740.585160:0:13073:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e10c9bea720 - data ffff9e10ffd28360/ffff9e10c9349400 00100000:10000000:0.0:1789081740.598054:0:13073:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789081740.628099:0:13073:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb7cb3d7479d5f62b 00000020:00000080:3.0:1789081740.628112:0:13073:0:(genops.c:906:class_export_put()) final put ffff9e110161e800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1789081740.628134:0:13073:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e10ff7e6800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1789081740.628138:0:13073:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e10ff7e6800 2 00000020:01000004:3.0:1789081740.628141:0:13073:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e10ff7e6800 from lustre-OST0001 00000020:00000080:3.0:1789081740.628164:0:13073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789081740.628175:0:13073:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1789081740.628178:0:13073:0:(genops.c:906:class_export_put()) final put ffff9e10d176d800/lustre-OST0001_UUID 00000020:00000080:3.0:1789081740.628181:0:13073:0:(genops.c:865:class_export_destroy()) destroying export ffff9e10d176d800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1789081740.628191:0:13073:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:2.0:1789081740.628463:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff9e110161e800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:3.0:1789081740.628509:0:13073:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import ee551687-7675-4fc6-9be1-2ccb62bdd809->MGS 00010000:00010000:3.0:1789081740.628556:0:13073:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e10c0030800/0xb7cb3d7479d5f53d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb7cb3d7479d5f544 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789081740.628784:0:13073:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e10c0030800/0xb7cb3d7479d5f53d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb7cb3d7479d5f544 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789081740.628791:0:13073:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1789081740.628794:0:13073:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1789081740.628798:0:13073:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1789081740.628816:0:13073:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e10d1a0d000 00010000:00010000:3.0:1789081740.628821:0:13073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e10c0030800/0xb7cb3d7479d5f53d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb7cb3d7479d5f544 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081740.628839:0:13073:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e1101998400/0xb7cb3d7479d5f77b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb7cb3d7479d5f782 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789081740.628846:0:13073:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e1101998400/0xb7cb3d7479d5f77b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb7cb3d7479d5f782 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789081740.628851:0:13073:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789081740.628853:0:13073:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1789081740.628854:0:13073:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1789081740.628867:0:13073:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e10d1a0d000 00010000:00010000:3.0:1789081740.628869:0:13073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e1101998400/0xb7cb3d7479d5f77b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb7cb3d7479d5f782 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789081740.629142:0:13073:0:(import.c:65:import_set_state_nolock()) ffff9e10d1a0d000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1789081740.629147:0:13073:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789081740.629150:0:13073:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789081740.629151:0:13073:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789081740.629156:0:13073:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789081740.629180:0:13073:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e10fada4e00 x1875987821317376/t0(0) o250->MGC192.168.201.117@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789081747 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789081740.629301:0:13073:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789081740.629313:0:13073:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:0.0:1789081740.629985:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ee551687-7675-4fc6-9be1-2ccb62bdd809:3302:1875987821317376:0@lo:250:ptlrpcd_00_00.0 10000000:01000000:3.0:1789081740.630063:0:13073:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789081740.630074:0:13073:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb7cb3d7479d5f41e 00000020:00000080:3.0:1789081740.630082:0:13073:0:(genops.c:906:class_export_put()) final put ffff9e10d1a08800/ee551687-7675-4fc6-9be1-2ccb62bdd809 00000020:01000000:3.0:1789081740.630102:0:13073:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.117@tcp (flags='') 00000020:00000080:3.0:1789081740.630110:0:13073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789081740.630117:0:13073:0:(obd_config.c:955:class_cleanup()) MGC192.168.201.117@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789081740.630121:0:13073:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9e10d1a03380) has no exports 10000000:01000000:3.0:1789081740.630145:0:5786:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1789081740.630388:0:13073:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.201.117@tcp: client import never connected 00000100:00080000:3.0:1789081740.630391:0:13073:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1789081740.630394:0:13073:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789081740.630396:0:13073:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1789081740.630399:0:13073:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789081740.630458:0:13073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789081740.630466:0:13073:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.117@tcp (uuid ee551687-7675-4fc6-9be1-2ccb62bdd809) 00000020:01000000:3.0:1789081740.630474:0:13073:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1789081740.630478:0:13073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789081740.630482:0:13073:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789081740.630488:0:13073:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9e110161a800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789081740.630494:0:13073:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff9e10f96919c0) has exports, disconnecting them 00000020:00080000:3.0:1789081740.630499:0:13073:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9e110161a800), last request at 1789081525 00000020:00000080:3.0:1789081740.630504:0:13073:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb7cb3d7479d5f655 00000020:00080000:3.0:1789081740.630517:0:13073:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e110161a800): rc 0 00000020:00000080:3.0:1789081740.630542:0:13073:0:(genops.c:906:class_export_put()) final put ffff9e110161a800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1789081740.632496:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff9e10d1a08800/ee551687-7675-4fc6-9be1-2ccb62bdd809 for MGC192.168.201.117@tcp 00000020:00000080:2.0:1789081740.632517:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff9e110161a800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1789081740.633156:0:491:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e10d1a0d000 for MGC192.168.201.117@tcp 00000020:00000080:2.0:1789081740.633165:0:491:0:(genops.c:906:class_export_put()) final put ffff9e10d1a0c800/ee551687-7675-4fc6-9be1-2ccb62bdd809 00000020:00000080:2.0:1789081740.633168:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff9e10d1a0c800/ee551687-7675-4fc6-9be1-2ccb62bdd809 for MGC192.168.201.117@tcp 00000020:01000000:2.0:1789081740.633184:0:491:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.117@tcp (ee551687-7675-4fc6-9be1-2ccb62bdd809) 00010000:01000000:2.0:1789081740.634965:0:13073:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1789081740.634974:0:13073:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789081740.634993:0:13073:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789081740.635000:0:13073:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789081740.635076:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1789081740.635208:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:2.0:1789081740.635288:0:5772:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9e10d2c09000:5772] 0 exiting: rc = 1 00000020:00000080:0.0:1789081740.635512:0:491:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e1101618800 for lustre-MDT0000-lwp-OST0001 00000100:00100000:2.0:1789081740.636624:0:5773:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9e10d2c08800:5773] 1 exiting: rc = 0 00000100:00100000:0.0:1789081740.636924:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.637211:0:5776:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9e10d1611c00:5776] 2 exiting: rc = 0 00000100:00100000:2.0:1789081740.637330:0:7481:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9e1101919400:7481] 3 exiting: rc = 0 00000100:00100000:2.0:1789081740.637399:0:5775:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9e10d2c09800:5775] 1 exiting: rc = 0 00000100:00100000:2.0:1789081740.648671:0:5774:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9e10d2c08a00:5774] 0 exiting: rc = 1 00000100:00100000:0.0:1789081740.648805:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.648815:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.648821:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.648829:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.648835:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.648841:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.648847:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.648854:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.648862:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.648867:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.648874:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.648878:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.648883:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.648920:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.648926:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.648932:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.648938:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.648944:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.648966:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.648971:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.648976:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.648981:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.648986:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.648990:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.648995:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.649001:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.649005:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.649010:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.649014:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.649019:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.649023:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.649028:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.649034:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.649039:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.649044:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.649049:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.649054:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.649059:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.649064:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.649069:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.649075:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.649080:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.649085:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.649093:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.649099:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.649103:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.649109:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.649115:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.649120:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.649125:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.649132:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.649137:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.649142:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.649156:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.649160:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.649166:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.649171:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.649176:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.649181:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.649186:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.649191:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.649196:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.649202:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.649207:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789081740.650413:0:13073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789081740.650426:0:13073:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1789081740.650432:0:13073:0:(genops.c:906:class_export_put()) final put ffff9e110161a000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1789081740.650438:0:13073:0:(genops.c:865:class_export_destroy()) destroying export ffff9e110161a000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1789081740.650444:0:13073:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1789081740.650490:0:13073:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e10ff7e6800 1 00000020:00000080:0.0:1789081740.650495:0:13073:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb7cb3d7479d5f5fa 00000020:00000080:0.0:1789081740.650502:0:13073:0:(genops.c:906:class_export_put()) final put ffff9e10ff7e5000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1789081740.650543:0:13073:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1789081740.650549:0:13073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789081740.650554:0:13073:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789081740.650557:0:13073:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9e10ff7d3380) has no exports 00000020:00000080:2.0:1789081740.650606:0:491:0:(genops.c:865:class_export_destroy()) destroying export ffff9e10ff7e5000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1789081740.669285:0:13073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789081740.669302:0:13073:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1789081740.669317:0:13073:0:(genops.c:906:class_export_put()) final put ffff9e10ff7e0800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1789081740.669322:0:13073:0:(genops.c:865:class_export_destroy()) destroying export ffff9e10ff7e0800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1789081740.669329:0:13073:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1789081740.669602:0:13073:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e10ff7e2000 00000020:01000000:0.0:1789081740.669628:0:13073:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1789081740.669632:0:13073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789081740.669636:0:13073:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789081740.669641:0:13073:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9e1101c619c0) has no exports 00000020:00000080:0.0:1789081740.669682:0:13073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789081740.669700:0:13073:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1789081740.669704:0:13073:0:(genops.c:906:class_export_put()) final put ffff9e10f958e800/OSS_uuid 00000020:00000080:0.0:1789081740.669706:0:13073:0:(genops.c:865:class_export_destroy()) destroying export ffff9e10f958e800/OSS_uuid for OSS 00000020:01000000:0.0:1789081740.669710:0:13073:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1789081740.669741:0:5785:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1789081740.669929:0:6584:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9e10d2c83800:6584] 2 exiting: rc = 0 00000100:00100000:0.0:1789081740.669982:0:7788:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9e10f9b4de00:7788] 3 exiting: rc = 0 00000100:00100000:0.0:1789081740.670029:0:6582:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9e10d0f1f600:6582] 1 exiting: rc = 0 00000100:00100000:3.0:1789081740.671555:0:6581:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9e10d0f1e000:6581] 0 exiting: rc = 1 00000100:00100000:0.0:1789081740.671774:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.671783:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.671789:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.671794:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.671800:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.671806:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.671810:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.671816:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.671822:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.671827:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.671832:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.671838:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.671843:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.671848:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.671853:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.671857:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.671863:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.671868:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.671873:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.671877:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.671883:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.671899:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.671905:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.671910:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.671915:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.671919:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.671940:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.671945:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.671950:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.671954:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.671959:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.671964:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.671969:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.671974:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.671978:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.671984:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.671990:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.671995:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.672000:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.672005:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.672010:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.672015:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.672020:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.672026:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.672032:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.672038:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.672043:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.672048:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.672053:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.672057:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.672062:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.672066:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.672071:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.672077:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.672081:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.672087:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.672092:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.672097:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.672102:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.672108:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.672113:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.672125:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.672130:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.672135:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673014:0:6585:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9e10c922ae00:6585] 0 exiting: rc = 1 00000100:00100000:0.0:1789081740.673090:0:6586:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9e10c922aa00:6586] 1 exiting: rc = 0 00000100:00100000:0.0:1789081740.673141:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673148:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673153:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673158:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673163:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673167:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673172:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673178:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673183:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673189:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673195:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673199:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673205:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673210:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673216:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673220:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673225:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673230:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673234:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673239:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673243:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673248:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673252:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673257:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673261:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673267:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673271:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673276:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673281:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673285:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673304:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673308:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673313:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673317:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673322:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673328:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673332:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673338:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673343:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673348:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673353:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673359:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673363:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673368:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673374:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673380:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673386:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673390:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673395:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673401:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673406:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673410:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673416:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673421:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673426:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673431:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673437:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673442:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673448:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673453:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673458:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673463:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673468:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.673480:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.674396:0:6588:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9e10fad7b800:6588] 1 exiting: rc = 0 00000100:00100000:0.0:1789081740.674603:0:6589:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9e10fad7b000:6589] 2 exiting: rc = 0 00000100:00100000:3.0:1789081740.679817:0:6587:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9e10fad7a000:6587] 0 exiting: rc = 1 00000100:00100000:0.0:1789081740.680147:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680156:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680163:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680181:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680188:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680194:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680200:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680206:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680211:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680217:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680222:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680228:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680235:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680241:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680248:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680254:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680273:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680291:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680297:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680303:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680441:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680449:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680455:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680462:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680468:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680473:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680478:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680484:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680490:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680496:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680502:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680508:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680513:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680518:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680573:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680579:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680586:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680592:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680598:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680603:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680623:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680631:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680636:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680642:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680648:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680654:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680661:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680667:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680672:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680677:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680682:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680702:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680709:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680714:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680719:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680724:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680730:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680736:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680742:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680755:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680763:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680770:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680776:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789081740.680781:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789081740.687193:0:6590:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9e10c93f1400:6590] 0 exiting: rc = 1 00000100:00100000:3.0:1789081740.687317:0:6591:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9e10c93f1800:6591] 1 exiting: rc = 0 00000100:00100000:2.0:1789081740.687474:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.687483:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.687489:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.687494:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.687499:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.687505:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.687511:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.687516:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.687548:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.687556:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.687561:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.687566:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.687571:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.687576:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.687581:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.687587:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.687591:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.687596:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.687602:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.687607:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.687613:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.687618:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.687623:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.687637:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.687643:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.687649:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.687654:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.687659:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.687664:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.687669:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.687674:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.687679:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.687695:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.687702:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.687707:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.689227:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.689236:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.689241:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.689247:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.689251:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.689256:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.689267:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.689272:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.689277:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.689281:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.689286:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.689291:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.689297:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.689302:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.689307:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.689312:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.689317:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.689321:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.689329:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.689333:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.689338:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.689343:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.689347:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.689377:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.689382:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.689386:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.689392:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.689398:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.689413:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.691756:0:6592:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9e10c93f0c00:6592] 0 exiting: rc = 1 00000100:00100000:3.0:1789081740.692158:0:6593:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9e10c93f1000:6593] 1 exiting: rc = 0 00000100:00100000:2.0:1789081740.692333:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692341:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692354:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692361:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692366:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692371:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692377:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692394:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692402:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692408:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692415:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692420:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692425:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692430:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692437:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692443:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692448:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692455:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692461:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692480:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692486:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692491:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692497:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692503:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692508:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692513:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692519:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692559:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692578:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692584:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692589:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692608:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692616:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692622:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692627:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692633:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692638:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692644:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692650:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692656:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692662:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692668:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692675:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692707:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692715:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692721:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692728:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692734:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692739:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692746:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692752:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692757:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692764:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692770:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692775:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692795:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692803:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692809:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692815:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692821:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692826:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692831:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692837:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789081740.692851:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1789081740.705015:0:13073:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1789081760.206825:0:13691:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg117-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789081768.752748:0:14103:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789081768.752753:0:14103:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1789081768.752863:0:14103:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9e10ff613800 00000020:01000004:3.0:1789081768.752879:0:14103:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1789081768.752886:0:14103:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789081768.752899:0:14103:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9e10f9223380) 00000020:00000080:3.0:1789081768.752913:0:14103:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789081768.765754:0:14103:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789081768.770291:0:14103:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1789081768.770786:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 353: rc = 0 00100000:10000000:2.0:1789081768.770881:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 353: rc = 0 00100000:10000000:2.0:1789081768.771072:0:14103:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789081768.771236:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 353: rc = 0 00100000:10000000:2.0:1789081768.771329:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 353: rc = 0 00100000:10000000:2.0:1789081768.771492:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 353: rc = 0 00100000:10000000:2.0:1789081768.771619:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 353: rc = 0 00100000:10000000:2.0:1789081768.771861:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 355: rc = 0 00100000:10000000:2.0:1789081768.773830:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 572: rc = 0 00100000:10000000:2.0:1789081768.773934:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 572: rc = 0 00100000:10000000:3.0:1789081768.774948:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 649: rc = 0 00100000:10000000:3.0:1789081768.775329:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 649: rc = 0 00100000:10000000:3.0:1789081768.775595:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 649: rc = 0 00100000:10000000:3.0:1789081768.775836:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 649: rc = 0 00100000:10000000:3.0:1789081768.776071:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 649: rc = 0 00100000:10000000:3.0:1789081768.776502:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 649: rc = 0 00100000:10000000:3.0:1789081768.776844:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 649: rc = 0 00100000:10000000:3.0:1789081768.777305:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 649: rc = 0 00100000:10000000:3.0:1789081768.777602:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 649: rc = 0 00100000:10000000:3.0:1789081768.777838:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 649: rc = 0 00100000:10000000:3.0:1789081768.778143:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 649: rc = 0 00100000:10000000:3.0:1789081768.778373:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 649: rc = 0 00100000:10000000:3.0:1789081768.778890:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 668: rc = 0 00100000:10000000:3.0:1789081768.779193:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 668: rc = 0 00100000:10000000:3.0:1789081768.779452:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 668: rc = 0 00100000:10000000:3.0:1789081768.780306:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 668: rc = 0 00100000:10000000:3.0:1789081768.780870:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 668: rc = 0 00100000:10000000:3.0:1789081768.781216:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 668: rc = 0 00100000:10000000:3.0:1789081768.781477:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 668: rc = 0 00100000:10000000:3.0:1789081768.782849:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 668: rc = 0 00100000:10000000:3.0:1789081768.783101:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 668: rc = 0 00100000:10000000:3.0:1789081768.783970:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 668: rc = 0 00100000:10000000:3.0:1789081768.784279:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 668: rc = 0 00100000:10000000:3.0:1789081768.784810:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 668: rc = 0 00100000:10000000:3.0:1789081768.785062:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 668: rc = 0 00100000:10000000:3.0:1789081768.785866:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 668: rc = 0 00100000:10000000:3.0:1789081768.786252:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 668: rc = 0 00100000:10000000:3.0:1789081768.786506:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 668: rc = 0 00100000:10000000:3.0:1789081768.787362:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 668: rc = 0 00100000:10000000:3.0:1789081768.787828:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 668: rc = 0 00100000:10000000:3.0:1789081768.788201:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 668: rc = 0 00100000:10000000:3.0:1789081768.788513:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 668: rc = 0 00100000:10000000:3.0:1789081768.788927:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 668: rc = 0 00100000:10000000:3.0:1789081768.789327:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 668: rc = 0 00100000:10000000:3.0:1789081768.794574:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 668: rc = 0 00100000:10000000:3.0:1789081768.794896:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 668: rc = 0 00100000:10000000:3.0:1789081768.795330:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 668: rc = 0 00100000:10000000:3.0:1789081768.795705:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 668: rc = 0 00100000:10000000:3.0:1789081768.798019:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 668: rc = 0 00100000:10000000:3.0:1789081768.799035:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 668: rc = 0 00100000:10000000:3.0:1789081768.799305:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 668: rc = 0 00100000:10000000:3.0:1789081768.800990:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 668: rc = 0 00100000:10000000:3.0:1789081768.802718:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 668: rc = 0 00100000:10000000:3.0:1789081768.803012:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 668: rc = 0 00100000:10000000:3.0:1789081768.804881:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 663: rc = 0 00100000:10000000:3.0:1789081768.805399:0:14103:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1789081768.805592:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 646: rc = 0 00100000:10000000:3.0:1789081768.805787:0:14103:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1789081768.805855:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 646: rc = 0 00100000:10000000:3.0:1789081768.806037:0:14103:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1789081768.806106:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 646: rc = 0 00100000:10000000:3.0:1789081768.806443:0:14103:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1789081768.806510:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 573: rc = 0 00100000:10000000:3.0:1789081768.806768:0:14103:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1789081768.806834:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 573: rc = 0 00100000:10000000:3.0:1789081768.807003:0:14103:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1789081768.807071:0:14103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 573: rc = 0 00000020:00000080:2.0:1789081768.816776:0:14103:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789081768.816785:0:14103:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789081768.816797:0:14103:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb7cb3d7479d6071f 00000020:01000004:2.0:1789081768.816805:0:14103:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789081768.816810:0:14103:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789081768.816815:0:14103:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e10ff613800 from MGS 00000020:01000004:2.0:1789081768.816819:0:14103:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789081768.816830:0:14103:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9e10ff7d4d40) 00000020:00000080:2.0:1789081768.816840:0:14103:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789081768.816890:0:14103:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e10ff613800 from MGS, refs=2 00080000:01000000:2.0:1789081768.816894:0:14103:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789081768.816898:0:14103:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb7cb3d7479d6072d 00000100:00100000:2.0:1789081768.816999:0:14103:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789081768.817351:0:14103:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789081768.817357:0:14103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789081768.817953:0:14103:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789081768.817960:0:14103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789081768.819105:0:14103:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789081768.819270:0:14103:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789081768.819276:0:14103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789081768.820099:0:14103:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789081768.820108:0:14103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789081768.820633:0:14103:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789081768.820640:0:14103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789081768.821121:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081768.821125:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081768.821127:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081768.823151:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081768.823157:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081768.823160:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081768.824893:0:14103:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789081768.826945:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1789081768.841118:0:14103:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1789081768.841139:0:14103:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789081768.841142:0:14103:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1789081768.861429:0:14112:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1789081768.861947:0:14103:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1789081768.862072:0:14103:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789081768.871637:0:14103:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1789081768.871940:0:14103:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789081768.875340:0:14103:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1789081768.875353:0:14103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789081768.877450:0:14103:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789081768.877631:0:14103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789081768.877958:0:14103:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789081768.877964:0:14103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789081768.879476:0:14103:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789081768.879501:0:14103:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.117@tcp' 00000020:01000004:2.0:1789081768.879503:0:14103:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789081768.879607:0:14103:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.117@tcp (typ=mgc) 00000020:00000080:2.0:1789081768.879620:0:14103:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.117@tcp (ffff9e10ff7d19c0) 00000020:00000080:2.0:1789081768.879637:0:14103:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789081768.879709:0:14103:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e10ff7e5800@MGC192.168.201.117@tcp: add connection 192.168.201.117@tcp at head 00010000:00010000:2.0:1789081768.879868:0:14103:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.117@tcp-0 is initialized 00000040:01000000:2.0:1789081768.879875:0:14103:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.117@tcp ctxt 1 is initialized 10000000:01000000:2.0:1789081768.880627:0:14118:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789081768.880691:0:14103:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.117@tcp (uuid 4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0) 00000020:00000080:3.0:1789081768.880708:0:14103:0:(genops.c:1406:class_connect()) connect: client 4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0, cookie 0xb7cb3d7479d6073b 00000100:00080000:3.0:1789081768.880718:0:14103:0:(import.c:510:import_select_connection()) MGC192.168.201.117@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789081768.880724:0:14103:0:(import.c:624:import_select_connection()) MGC192.168.201.117@tcp: import ffff9e10ff7e5800 using connection 192.168.201.117@tcp/0@lo 00000100:00100000:3.0:1789081768.880757:0:14103:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e10f5c01f80 x1875987821317632/t0(0) o250->MGC192.168.201.117@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789081768.880785:0:14103:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0->MGS 00000020:01000004:3.0:1789081768.880811:0:14103:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789081768.880816:0:14103:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789081768.880827:0:14103:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9e10f9224d40) 00000020:00000080:3.0:1789081768.880837:0:14103:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1789081768.880962:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:3302:1875987821317632:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1789081768.881027:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081768.881122:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821317632 00000100:00100000:2.0:1789081768.881128:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821317632 00000100:00100000:2.0:1789081768.881160:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789081768.881167:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3302:x1875987821317632:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1789081768.881358:0:14114:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0@0@lo t0 exp 0000000000000000 cur 435 last 0 00000020:00000080:2.0:1789081768.881380:0:14114:0:(genops.c:1406:class_connect()) connect: client 4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0, cookie 0xb7cb3d7479d60749 00000100:00080000:2.0:1789081768.881521:0:14114:0:(import.c:65:import_set_state_nolock()) ffff9e10ff7e7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789081768.881597:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+5:3302:x1875987821317632:12345-0@lo:250:mount.lustre.0 Request processed in 429us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081768.881616:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789081768.881660:0:3302:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.201.117@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1789081768.881667:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.117@tcp: connect to target with instance 0 00000100:00080000:2.0:1789081768.881674:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.117@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1789081768.881677:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1789081768.881680:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e10ff7e5800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1789081768.881683:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1789081768.881690:0:3302:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1789081768.881694:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:3302:1875987821317632:0@lo:250:mount.lustre.0 00000100:00080000:0.0:1789081768.885164:0:14117:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:3.0:1789081768.908890:0:14103:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789081768.909067:0:14103:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789081768.909073:0:14103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789081768.915406:0:14103:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789081768.915423:0:14103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1789081768.916327:0:14103:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1789081768.916336:0:14103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789081768.929369:0:14103:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789081768.929800:0:14103:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789081768.929807:0:14103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789081768.931971:0:14103:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789081768.931985:0:14103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789081769.065857:0:14103:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789081769.066045:0:14103:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789081769.066359:0:14103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789081769.069755:0:14103:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789081769.069769:0:14103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789081769.070775:0:14103:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789081769.071007:0:14103:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789081769.071020:0:14103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789081769.073609:0:14103:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789081769.073622:0:14103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789081769.074276:0:14103:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789081769.074446:0:14103:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789081769.074451:0:14103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789081769.077850:0:14103:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789081769.077866:0:14103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789081769.078497:0:14103:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789081769.078695:0:14103:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789081769.078700:0:14103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789081769.079346:0:14103:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789081769.079353:0:14103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1789081769.123849:0:14103:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789081769.124029:0:14103:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789081769.124035:0:14103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1789081769.126327:0:14103:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789081769.126341:0:14103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789081769.138115:0:14103:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789081769.138132:0:14103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789081769.139722:0:14103:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789081769.139747:0:14103:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1789081769.139753:0:14103:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.117@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789081769.139888:0:14103:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.117@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789081769.139926:0:14103:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.117@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1789081769.139931:0:14103:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789081769.139932:0:14103:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789081769.139933:0:14103:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789081769.139934:0:14103:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789081769.139935:0:14103:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789081769.139937:0:14103:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789081769.139938:0:14103:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789081769.139939:0:14103:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789081769.139941:0:14103:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789081769.139943:0:14103:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789081769.139945:0:14103:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1789081769.139947:0:14103:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789081769.139948:0:14103:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789081769.139950:0:14103:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789081769.139951:0:14103:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789081769.139952:0:14103:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789081769.139953:0:14103:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789081769.139954:0:14103:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789081769.139955:0:14103:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789081769.139956:0:14103:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789081769.139957:0:14103:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789081769.139989:0:14103:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789081769.140008:0:14103:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14103:1875987821317760:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789081769.140132:0:14103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081769.140228:0:14103:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d106db40 going to sleep for 11 seconds 00000100:00100000:3.0:1789081769.140317:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821317760 00000100:00100000:3.0:1789081769.140324:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821317760 00000100:00100000:3.0:1789081769.140449:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789081769.140458:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+5:14103:x1875987821317760:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789081769.140507:0:14116:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789081769.140510:0:14116:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789081769.140512:0:14116:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1789081769.140956:0:14137:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1789081769.141448:0:14116:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1789081769.143792:0:14138:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1789081769.143801:0:14138:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1789081769.143803:0:14138:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1789081769.143836:0:14138:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1789081769.144636:0:14116:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789081769.144648:0:14116:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789081769.150840:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+5:14103:x1875987821317760:12345-0@lo:253:mount.lustre.0 Request processed in 10373us (10698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081769.150855:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789081769.150868:0:14103:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14103:1875987821317760:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789081769.150882:0:14103:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789081769.150885:0:14103:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789081769.150887:0:14103:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789081769.150888:0:14103:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789081769.150889:0:14103:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789081769.150890:0:14103:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789081769.150892:0:14103:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789081769.150893:0:14103:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789081769.150895:0:14103:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789081769.150897:0:14103:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789081769.150898:0:14103:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789081769.150918:0:14103:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e10ff613800 from lustre-MDT0000 10000000:01000000:1.0:1789081769.150950:0:14103:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789081769.150953:0:14103:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789081769.150957:0:14103:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9e10ff7d19c0 10000000:01000000:1.0:1789081769.150962:0:14103:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789081769.150969:0:14103:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9e10ff7d19c0 from 1 10000000:01000000:1.0:1789081769.150973:0:14103:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789081769.151013:0:14103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0200/0xb7cb3d7479d60750 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081769.151030:0:14103:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0200/0xb7cb3d7479d60750 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081769.151040:0:14103:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0200/0xb7cb3d7479d60750 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081769.151565:0:14103:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14103:1875987821317888:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789081769.151626:0:14103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081769.151669:0:14103:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d106d240 going to sleep for 11 seconds 00000100:00100000:2.0:1789081769.151771:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821317888 00000100:00100000:2.0:1789081769.151777:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821317888 00000100:00100000:2.0:1789081769.151822:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789081769.151831:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+5:14103:x1875987821317888:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789081769.151846:0:14115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081769.151863:0:14115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e1101775e00/0xb7cb3d7479d60757 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d60750 expref: -99 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081769.151886:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e1101775e00/0xb7cb3d7479d60757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d60750 expref: 6 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081769.151896:0:14115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e1101775e00/0xb7cb3d7479d60757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d60750 expref: 6 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081769.151915:0:14115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101775e00, rc 0) 00000100:00100000:2.0:1789081769.151998:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+6:14103:x1875987821317888:12345-0@lo:101:mount.lustre.0 Request processed in 168us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081769.152005:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789081769.152262:0:14103:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14103:1875987821317888:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789081769.152276:0:14103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0200/0xb7cb3d7479d60750 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d60757 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081769.152285:0:14103:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0200/0xb7cb3d7479d60750 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d60757 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081769.152421:0:14103:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14103:1875987821318016:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789081769.152449:0:14103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081769.152511:0:14103:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d106d240 going to sleep for 11 seconds 00000100:00100000:3.0:1789081769.154280:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821318016 00000100:00100000:3.0:1789081769.154298:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821318016 00000100:00100000:3.0:1789081769.154478:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789081769.154489:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+6:14103:x1875987821318016:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789081769.154832:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+6:14103:x1875987821318016:12345-0@lo:501:mount.lustre.0 Request processed in 345us (2381us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789081769.154848:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789081769.154978:0:14103:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14103:1875987821318016:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789081769.155025:0:14103:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789081769.155041:0:14103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0200/0xb7cb3d7479d60750 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d60757 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081769.155050:0:14103:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0200/0xb7cb3d7479d60750 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d60757 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789081769.155058:0:14103:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e10ff613800 10000000:01000000:1.0:1789081769.155063:0:14103:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789081769.155067:0:14103:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e10ff613800 10000000:01000000:1.0:1789081769.155069:0:14103:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789081769.155072:0:14103:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9e10ff613800 from 1 10000000:01000000:1.0:1789081769.155074:0:14103:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789081769.155104:0:14103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd1400/0xb7cb3d7479d6075e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081769.155118:0:14103:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd1400/0xb7cb3d7479d6075e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081769.155128:0:14103:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd1400/0xb7cb3d7479d6075e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081769.155149:0:14103:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14103:1875987821318144:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789081769.155201:0:14103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081769.155480:0:14103:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d106d240 going to sleep for 11 seconds 00000100:00100000:2.0:1789081769.155673:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821318144 00000100:00100000:2.0:1789081769.155679:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821318144 00000100:00100000:3.0:1789081769.155746:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789081769.155755:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+6:14103:x1875987821318144:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789081769.155767:0:14116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081769.155784:0:14116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e1101999200/0xb7cb3d7479d60765 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d6075e expref: -99 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081769.155805:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e1101999200/0xb7cb3d7479d60765 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d6075e expref: 7 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081769.155815:0:14116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e1101999200/0xb7cb3d7479d60765 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d6075e expref: 7 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081769.155823:0:14116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101999200, rc 0) 00000100:00100000:3.0:1789081769.155866:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+7:14103:x1875987821318144:12345-0@lo:101:mount.lustre.0 Request processed in 113us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081769.155872:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789081769.155944:0:14103:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14103:1875987821318144:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789081769.155956:0:14103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd1400/0xb7cb3d7479d6075e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d60765 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081769.155964:0:14103:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd1400/0xb7cb3d7479d6075e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d60765 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789081769.155978:0:14103:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789081769.155981:0:14103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd1400/0xb7cb3d7479d6075e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d60765 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081769.155987:0:14103:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd1400/0xb7cb3d7479d6075e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d60765 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789081769.155993:0:14103:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789081769.155997:0:14103:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789081769.156001:0:14103:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e10ff613800 10000000:01000000:1.0:1789081769.156003:0:14103:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789081769.156016:0:14103:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789081769.156018:0:14103:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789081769.156034:0:14103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0c00/0xb7cb3d7479d6076c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081769.156040:0:14103:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0c00/0xb7cb3d7479d6076c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081769.156047:0:14103:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0c00/0xb7cb3d7479d6076c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081769.156060:0:14103:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14103:1875987821318272:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789081769.156085:0:14103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081769.156216:0:14103:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d106d240 going to sleep for 11 seconds 00000100:00100000:0.0:1789081769.156342:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821318272 00000100:00100000:0.0:1789081769.156346:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821318272 00000100:00100000:0.0:1789081769.156371:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789081769.156388:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+7:14103:x1875987821318272:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789081769.156395:0:14114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081769.156407:0:14114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e1101982000/0xb7cb3d7479d60773 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d6076c expref: -99 pid: 14114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081769.156422:0:14114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e1101982000/0xb7cb3d7479d60773 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d6076c expref: 8 pid: 14114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081769.156446:0:14114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e1101982000/0xb7cb3d7479d60773 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d6076c expref: 8 pid: 14114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081769.156454:0:14114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101982000, rc 0) 00000100:00100000:0.0:1789081769.156493:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+8:14103:x1875987821318272:12345-0@lo:101:mount.lustre.0 Request processed in 115us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081769.156499:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789081769.156588:0:14103:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14103:1875987821318272:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789081769.156599:0:14103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0c00/0xb7cb3d7479d6076c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d60773 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081769.156606:0:14103:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0c00/0xb7cb3d7479d6076c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d60773 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081769.156649:0:14103:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14103:1875987821318400:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789081769.156672:0:14103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081769.156709:0:14103:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d106d240 going to sleep for 11 seconds 00000100:00100000:0.0:1789081769.156810:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821318400 00000100:00100000:0.0:1789081769.156814:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821318400 00000100:00100000:0.0:1789081769.156831:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789081769.156835:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+8:14103:x1875987821318400:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789081769.157193:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+9:14103:x1875987821318400:12345-0@lo:501:mount.lustre.0 Request processed in 355us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081769.157200:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789081769.157340:0:14103:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14103:1875987821318400:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789081769.157370:0:14103:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14103:1875987821318528:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789081769.157417:0:14103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081769.157445:0:14103:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d106d240 going to sleep for 11 seconds 00000100:00100000:0.0:1789081769.157570:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821318528 00000100:00100000:0.0:1789081769.157575:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821318528 00000100:00100000:0.0:1789081769.157594:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789081769.157601:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+9:14103:x1875987821318528:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789081769.157884:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+9:14103:x1875987821318528:12345-0@lo:503:mount.lustre.0 Request processed in 282us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081769.157892:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789081769.158346:0:14103:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14103:1875987821318528:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789081769.158831:0:14139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b27100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14139:1875987821318656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789081769.158881:0:14139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081769.158916:0:14139:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d2d159c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789081769.158970:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821318656 00000100:00100000:1.0:1789081769.158975:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821318656 00000100:00100000:1.0:1789081769.159002:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789081769.159008:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+9:14139:x1875987821318656:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789081769.159445:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+9:14139:x1875987821318656:12345-0@lo:502:llog_process_th.0 Request processed in 436us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081769.159453:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789081769.159703:0:14139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b27100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14139:1875987821318656:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789081769.159734:0:14139:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789081769.159746:0:14139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789081769.159748:0:14139:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789081769.159754:0:14139:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1789081769.159757:0:14139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789081769.159771:0:14139:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9e10ee9b0000) 00000020:00000080:0.0:1789081769.159789:0:14139:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1789081769.159795:0:14139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789081769.159857:0:14139:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789081769.159864:0:14139:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb7cb3d7479d60781 00000020:00000080:0.0:1789081769.160064:0:14139:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789081769.160069:0:14139:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789081769.160072:0:14139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789081769.160074:0:14139:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789081769.160076:0:14139:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789081769.160080:0:14139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789081769.160081:0:14139:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1789081769.160085:0:14139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789081769.160092:0:14139:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9e10ee9b3380) 00000020:00000080:0.0:1789081769.160101:0:14139:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1789081769.160106:0:14139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789081769.160107:0:14139:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1789081769.160110:0:14139:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1789081769.160116:0:14139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789081769.160166:0:14139:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e10ff613800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1789081769.160251:0:14139:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9e10ee9b4d40) 00000020:00000080:0.0:1789081769.160261:0:14139:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1789081769.160307:0:14139:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789081769.160312:0:14139:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb7cb3d7479d60796 00000020:00000080:0.0:1789081769.160478:0:14139:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1789081769.160485:0:14139:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789081769.160490:0:14139:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xb7cb3d7479d6079d 00080000:01000000:0.0:1789081769.160500:0:14139:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789081769.160503:0:14139:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb7cb3d7479d607a4 00010000:00010000:2.0:1789081769.238045:0:14139:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1789081769.238883:0:14139:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:2.0:1789081769.239248:0:14139:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789081769.239932:0:14139:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9e10ff7d3380) 00000020:00000080:2.0:1789081769.239950:0:14139:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789081769.240016:0:14139:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789081769.240024:0:14139:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb7cb3d7479d607b2 00000020:00000080:3.0:1789081769.240994:0:14139:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789081769.250582:0:14139:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xb7cb3d7479d607b9 00000020:00000080:1.0:1789081769.251411:0:14139:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789081769.251422:0:14139:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789081769.251429:0:14139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789081769.251431:0:14139:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789081769.251435:0:14139:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789081769.251441:0:14139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789081769.251443:0:14139:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789081769.251447:0:14139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789081769.251487:0:14139:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789081769.251514:0:14139:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789081769.251518:0:14139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789081769.251519:0:14139:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1789081769.251545:0:14139:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789081769.251548:0:14139:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1789081769.251550:0:14139:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789081769.251551:0:14139:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789081769.251553:0:14139:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789081769.251556:0:14139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789081769.251557:0:14139:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789081769.251560:0:14139:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789081769.251563:0:14139:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789081769.251566:0:14139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789081769.251574:0:14139:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789081769.251579:0:14139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789081769.251584:0:14139:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.117@tcp to nid 0x20000c0a8c975 (192.168.201.117@tcp) 00000020:01000000:1.0:1789081769.251610:0:14139:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789081769.251613:0:14139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789081769.251628:0:14139:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9e10f96919c0) 00000020:00000080:1.0:1789081769.251642:0:14139:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1789081769.251648:0:14139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789081769.251711:0:14139:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789081769.251716:0:14139:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789081769.251722:0:14139:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb7cb3d7479d607c7 00010000:00080000:1.0:1789081769.251753:0:14139:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e10f97e8800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.117@tcp at head 00010000:00010000:1.0:1789081769.251978:0:14139:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1789081769.252771:0:14139:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789081769.252814:0:14139:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789081769.253952:0:14139:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789081769.254006:0:14139:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1789081769.254069:0:14139:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1789081769.259558:0:14143:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789081769.259566:0:14143:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789081769.262174:0:14139:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789081769.262320:0:14139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789081769.263144:0:14139:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789081769.263169:0:14139:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb7cb3d7479d607ce 00000100:00080000:3.0:1789081769.263256:0:14139:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789081769.263263:0:14139:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e10f97e8800 using connection 192.168.201.117@tcp/0@lo 00000100:00100000:3.0:1789081769.263303:0:14139:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e10f5c01f80 x1875987821318784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789081769.263360:0:14139:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1789081769.263439:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875987821318784:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789081769.263490:0:3302:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875987821318784 offset 0 length 520: 4 00000020:01000000:3.0:1789081769.263648:0:14139:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789081769.263653:0:14139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789081769.263655:0:14139:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789081769.263658:0:14139:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789081769.263661:0:14139:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1789081769.263662:0:14139:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789081769.263664:0:14139:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789081769.263665:0:14139:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789081769.263668:0:14139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789081769.263669:0:14139:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789081769.263672:0:14139:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789081769.263676:0:14139:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789081769.263679:0:14139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789081769.263680:0:14139:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789081769.263683:0:14139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789081769.263687:0:14139:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.117@tcp to nid 0x20000c0a8c975 (192.168.201.117@tcp) 00000020:01000000:3.0:1789081769.263709:0:14139:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789081769.263712:0:14139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789081769.263724:0:14139:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9e10f92219c0) 00000020:00000080:3.0:1789081769.263738:0:14139:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1789081769.263743:0:14139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789081769.263811:0:14139:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789081769.263815:0:14139:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789081769.263820:0:14139:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb7cb3d7479d607dc 00010000:00080000:3.0:1789081769.263840:0:14139:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e10ff77b000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.117@tcp at head 00010000:00010000:3.0:1789081769.264017:0:14139:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1789081769.264807:0:14139:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789081769.264833:0:14139:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789081769.266277:0:14139:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789081769.266443:0:14139:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1789081769.266676:0:14139:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1789081769.267916:0:14145:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789081769.267923:0:14145:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789081769.268981:0:14139:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789081769.268995:0:14139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789081769.269030:0:14139:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789081769.269050:0:14139:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb7cb3d7479d607e3 00000100:00080000:3.0:1789081769.269061:0:14139:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789081769.269066:0:14139:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e10ff77b000 using connection 192.168.201.117@tcp/0@lo 00000100:00100000:3.0:1789081769.269100:0:14139:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e10f5c01180 x1875987821318912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789081769.269158:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875987821318912:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789081769.269221:0:3302:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875987821318912 offset 0 length 520: 4 00000100:00080000:3.0:1789081769.269336:0:14139:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789081769.269442:0:14139:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789081769.269446:0:14139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789081769.269448:0:14139:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789081769.269451:0:14139:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789081769.269455:0:14139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789081769.269456:0:14139:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789081769.269459:0:14139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789081769.269461:0:14139:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789081769.269463:0:14139:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789081769.269465:0:14139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789081769.269467:0:14139:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789081769.269469:0:14139:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789081769.269471:0:14139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789081769.269473:0:14139:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789081769.269477:0:14139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789081769.269505:0:14139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c00700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14139:1875987821319040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789081769.269577:0:14139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081769.269599:0:14139:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10fa800a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789081769.269714:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821319040 00000100:00100000:1.0:1789081769.269721:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821319040 00000100:00100000:1.0:1789081769.269768:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789081769.269777:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+9:14139:x1875987821319040:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789081769.269999:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+9:14139:x1875987821319040:12345-0@lo:502:llog_process_th.0 Request processed in 223us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081769.270008:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789081769.270112:0:14139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c00700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14139:1875987821319040:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789081769.270139:0:14139:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789081769.270147:0:14139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789081769.270149:0:14139:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789081769.270152:0:14139:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1789081769.270424:0:14103:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1789081769.270440:0:14103:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789081769.270456:0:14103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0c00/0xb7cb3d7479d6076c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d60773 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081769.270478:0:14103:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0c00/0xb7cb3d7479d6076c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d60773 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789081769.270487:0:14103:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e10ff613800 from 1 10000000:01000000:1.0:1789081769.270490:0:14103:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789081769.270517:0:14103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0600/0xb7cb3d7479d607ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081769.270547:0:14103:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0600/0xb7cb3d7479d607ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081769.270557:0:14103:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0600/0xb7cb3d7479d607ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081769.270571:0:14103:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14103:1875987821319168:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789081769.270600:0:14103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081769.270612:0:14103:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c8327300 going to sleep for 11 seconds 00000100:00100000:3.0:1789081769.270698:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821319168 00000100:00100000:3.0:1789081769.270703:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821319168 00000100:00100000:3.0:1789081769.270724:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789081769.270730:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+9:14103:x1875987821319168:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789081769.270739:0:14116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081769.270751:0:14116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e1101999c00/0xb7cb3d7479d607f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d607ea expref: -99 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081769.270769:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e1101999c00/0xb7cb3d7479d607f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d607ea expref: 10 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081769.270779:0:14116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e1101999c00/0xb7cb3d7479d607f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d607ea expref: 10 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081769.270786:0:14116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101999c00, rc 0) 00000100:00100000:3.0:1789081769.270814:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+10:14103:x1875987821319168:12345-0@lo:101:mount.lustre.0 Request processed in 84us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081769.270819:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789081769.270902:0:14103:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14103:1875987821319168:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789081769.270914:0:14103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0600/0xb7cb3d7479d607ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d607f1 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081769.270922:0:14103:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0600/0xb7cb3d7479d607ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d607f1 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081769.271783:0:14103:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14103:1875987821319296:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1789081769.271829:0:14103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081769.271860:0:14103:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c8327300 going to sleep for 11 seconds 00000100:00100000:3.0:1789081769.272783:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821319296 00000100:00100000:3.0:1789081769.272793:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821319296 00000100:00100000:3.0:1789081769.272833:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789081769.272840:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+10:14103:x1875987821319296:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1789081769.272861:0:14115:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789081769.272867:0:14115:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789081769.272945:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+10:14103:x1875987821319296:12345-0@lo:256:mount.lustre.0 Request processed in 105us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081769.272961:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789081769.275295:0:14103:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14103:1875987821319296:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789081769.276462:0:14103:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789081769.276549:0:14103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0600/0xb7cb3d7479d607ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d607f1 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081769.276562:0:14103:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0600/0xb7cb3d7479d607ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d607f1 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789081769.276571:0:14103:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e10ff613800 from 1 10000000:01000000:1.0:1789081769.276574:0:14103:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789081769.276615:0:14103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd1a00/0xb7cb3d7479d607f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081769.276624:0:14103:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd1a00/0xb7cb3d7479d607f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081769.276634:0:14103:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd1a00/0xb7cb3d7479d607f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081769.276659:0:14103:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14103:1875987821319424:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789081769.276719:0:14103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081769.276766:0:14103:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c8327300 going to sleep for 11 seconds 00000100:00100000:2.0:1789081769.276844:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821319424 00000100:00100000:2.0:1789081769.276851:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821319424 00000100:00100000:2.0:1789081769.276905:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789081769.276914:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+10:14103:x1875987821319424:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789081769.276928:0:14114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081769.276943:0:14114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e1101774c00/0xb7cb3d7479d607ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d607f8 expref: -99 pid: 14114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081769.276978:0:14114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e1101774c00/0xb7cb3d7479d607ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d607f8 expref: 11 pid: 14114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081769.276989:0:14114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e1101774c00/0xb7cb3d7479d607ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d607f8 expref: 11 pid: 14114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081769.276998:0:14114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101774c00, rc 0) 00000100:00100000:2.0:1789081769.277042:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+11:14103:x1875987821319424:12345-0@lo:101:mount.lustre.0 Request processed in 129us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081769.277050:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789081769.277138:0:14103:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14103:1875987821319424:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789081769.277151:0:14103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd1a00/0xb7cb3d7479d607f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d607ff expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081769.277160:0:14103:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd1a00/0xb7cb3d7479d607f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d607ff expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081769.277229:0:14103:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14103:1875987821319552:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789081769.277251:0:14103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081769.277274:0:14103:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c8327300 going to sleep for 11 seconds 00000100:00100000:2.0:1789081769.277428:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821319552 00000100:00100000:2.0:1789081769.277433:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821319552 00000100:00100000:2.0:1789081769.277459:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789081769.277465:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+11:14103:x1875987821319552:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789081769.277842:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+11:14103:x1875987821319552:12345-0@lo:501:mount.lustre.0 Request processed in 376us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081769.277850:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789081769.277937:0:14103:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14103:1875987821319552:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789081769.277967:0:14103:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14103:1875987821319680:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789081769.278004:0:14103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081769.278030:0:14103:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c8327300 going to sleep for 11 seconds 00000100:00100000:2.0:1789081769.278084:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821319680 00000100:00100000:2.0:1789081769.278088:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821319680 00000100:00100000:2.0:1789081769.278118:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789081769.278124:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+11:14103:x1875987821319680:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789081769.278275:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+11:14103:x1875987821319680:12345-0@lo:503:mount.lustre.0 Request processed in 150us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081769.278282:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789081769.278493:0:14103:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14103:1875987821319680:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789081769.278949:0:14147:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b27100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14147:1875987821319808:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789081769.278993:0:14147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081769.279022:0:14147:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d2d15780 going to sleep for 11 seconds 00000100:00100000:2.0:1789081769.279072:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821319808 00000100:00100000:2.0:1789081769.279077:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821319808 00000100:00100000:2.0:1789081769.279154:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789081769.279161:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+11:14147:x1875987821319808:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789081769.279390:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+11:14147:x1875987821319808:12345-0@lo:502:llog_process_th.0 Request processed in 229us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081769.279397:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789081769.279799:0:14147:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b27100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14147:1875987821319808:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789081769.279826:0:14147:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789081769.279835:0:14147:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789081769.279837:0:14147:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789081769.279844:0:14147:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e10ff613800 00000020:00000080:0.0:1789081769.279847:0:14147:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789081769.279855:0:14147:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789081769.279858:0:14147:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789081769.279860:0:14147:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789081769.279862:0:14147:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789081769.279864:0:14147:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789081769.279866:0:14147:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789081769.279870:0:14147:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e10ff613800 00000020:00000080:0.0:1789081769.279872:0:14147:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789081769.279937:0:14147:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789081769.279941:0:14147:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789081769.279942:0:14147:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789081769.279944:0:14147:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789081769.279947:0:14147:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789081769.279948:0:14147:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789081769.279952:0:14147:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e10ff613800 00000020:00000080:0.0:1789081769.279954:0:14147:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789081769.279990:0:14147:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b27100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14147:1875987821319936:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789081769.280030:0:14147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081769.285277:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821319936 00000100:00100000:1.0:1789081769.285289:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821319936 00000100:00100000:1.0:1789081769.286918:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789081769.286934:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+11:14147:x1875987821319936:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789081769.287282:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+11:14147:x1875987821319936:12345-0@lo:502:llog_process_th.0 Request processed in 352us (7250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081769.287290:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789081769.287621:0:14147:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d2d15780 going to sleep for 11 seconds 00000100:00100000:2.0:1789081769.287650:0:14147:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b27100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14147:1875987821319936:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789081769.287685:0:14147:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789081769.287692:0:14147:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789081769.287695:0:14147:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789081769.287699:0:14147:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789081769.287852:0:14103:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1789081769.287868:0:14103:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789081769.287887:0:14103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd1a00/0xb7cb3d7479d607f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d607ff expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081769.287898:0:14103:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd1a00/0xb7cb3d7479d607f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d607ff expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789081769.287943:0:14103:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789081769.287952:0:14103:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e10ff613800 10000000:01000000:1.0:1789081769.287955:0:14103:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e10ff613800 10000000:01000000:1.0:1789081769.287958:0:14103:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789081769.287963:0:14103:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e10ff613800 from 1 10000000:01000000:1.0:1789081769.287965:0:14103:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789081769.287990:0:14103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0000/0xb7cb3d7479d60806 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081769.287996:0:14103:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0000/0xb7cb3d7479d60806 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081769.288003:0:14103:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0000/0xb7cb3d7479d60806 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081769.288018:0:14103:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14103:1875987821320064:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789081769.288050:0:14103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081769.288068:0:14103:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d106db40 going to sleep for 11 seconds 00000100:00100000:2.0:1789081769.288273:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821320064 00000100:00100000:2.0:1789081769.288278:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821320064 00000100:00100000:2.0:1789081769.288308:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789081769.288313:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+11:14103:x1875987821320064:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789081769.288322:0:14116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081769.288332:0:14116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e1101774600/0xb7cb3d7479d6080d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d60806 expref: -99 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081769.288424:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e1101774600/0xb7cb3d7479d6080d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d60806 expref: 12 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081769.288436:0:14116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e1101774600/0xb7cb3d7479d6080d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d60806 expref: 12 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081769.288444:0:14116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101774600, rc 0) 00000100:00100000:2.0:1789081769.288475:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+12:14103:x1875987821320064:12345-0@lo:101:mount.lustre.0 Request processed in 162us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081769.288491:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789081769.289293:0:14103:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14103:1875987821320064:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789081769.289310:0:14103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0000/0xb7cb3d7479d60806 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d6080d expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081769.289320:0:14103:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0000/0xb7cb3d7479d60806 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d6080d expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081769.289465:0:14103:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14103:1875987821320192:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789081769.289503:0:14103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081769.289544:0:14103:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d106db40 going to sleep for 11 seconds 00000100:00100000:0.0:1789081769.289576:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821320192 00000100:00100000:0.0:1789081769.289581:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821320192 00000100:00100000:0.0:1789081769.289613:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789081769.289620:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+12:14103:x1875987821320192:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789081769.289862:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+12:14103:x1875987821320192:12345-0@lo:501:mount.lustre.0 Request processed in 242us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081769.289870:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789081769.289908:0:14103:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14103:1875987821320192:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789081769.289937:0:14103:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14103:1875987821320320:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789081769.289973:0:14103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081769.289985:0:14103:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d2d159c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789081769.289998:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821320320 00000100:00100000:0.0:1789081769.290001:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821320320 00000100:00100000:0.0:1789081769.290022:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789081769.290027:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+12:14103:x1875987821320320:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789081769.291668:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+12:14103:x1875987821320320:12345-0@lo:503:mount.lustre.0 Request processed in 1633us (1687us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081769.291682:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789081769.291752:0:14103:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14103:1875987821320320:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789081769.292783:0:14150:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b27b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14150:1875987821320448:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789081769.292839:0:14150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081769.292869:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821320448 00000100:00100000:0.0:1789081769.292875:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821320448 00000100:00100000:0.0:1789081769.292908:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789081769.292915:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+12:14150:x1875987821320448:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789081769.293512:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+12:14150:x1875987821320448:12345-0@lo:502:llog_process_th.0 Request processed in 595us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081769.293520:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789081769.293601:0:14150:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d2d159c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789081769.293619:0:14150:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b27b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14150:1875987821320448:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1789081769.293677:0:14150:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1789081769.293692:0:14150:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9e10ee9b19c0) 00000020:00000080:0.0:1789081769.293714:0:14150:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1789081769.295787:0:14150:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e10ff613800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789081769.295797:0:14150:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e10ff613800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789081769.295800:0:14150:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e10ff613800 4 00010000:00080000:0.0:1789081769.295836:0:14150:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e10e7c10000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.117@tcp at head 00010000:00010000:0.0:1789081769.297385:0:14150:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1789081769.297498:0:14150:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1789081769.297558:0:14150:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789081769.297573:0:14150:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xb7cb3d7479d6081b 00000100:00080000:0.0:1789081769.297584:0:14150:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789081769.297589:0:14150:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e10e7c10000 using connection 192.168.201.117@tcp/0@lo 00000100:00100000:0.0:1789081769.297624:0:14150:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e10f9b27b80 x1875987821320576/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789081769.297656:0:14150:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789081769.297924:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875987821320576:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789081769.297992:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081769.298065:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821320576 00000100:00100000:2.0:1789081769.298072:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821320576 00000100:00100000:2.0:1789081769.303324:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789081769.303353:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1875987821320576:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789081769.303474:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1875987821320576:12345-0@lo:38:llog_process_th.0 Request processed in 122us (5480us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789081769.303482:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789081769.303562:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789081769.303585:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e10e7c10000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789081769.303590:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789081769.303594:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875987821320576:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789081769.305879:0:14150:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b24a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14150:1875987821320704:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789081769.305964:0:14150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081769.306013:0:14150:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c53f7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789081769.306258:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821320704 00000100:00100000:1.0:1789081769.306266:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821320704 00000100:00100000:1.0:1789081769.306327:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789081769.306336:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+12:14150:x1875987821320704:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789081769.308389:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+12:14150:x1875987821320704:12345-0@lo:502:llog_process_th.0 Request processed in 2034us (2405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081769.308405:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789081769.309250:0:14150:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b24a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14150:1875987821320704:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789081769.309294:0:14150:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789081769.309738:0:14103:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1789081769.309762:0:14103:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789081769.309779:0:14103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0000/0xb7cb3d7479d60806 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d6080d expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081769.309790:0:14103:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0000/0xb7cb3d7479d60806 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d6080d expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789081769.309830:0:14103:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789081769.309833:0:14103:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789081769.309834:0:14103:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789081769.309835:0:14103:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789081769.309837:0:14103:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789081769.309838:0:14103:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789081769.309839:0:14103:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789081769.309841:0:14103:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789081769.309842:0:14103:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789081769.309843:0:14103:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789081769.309847:0:14103:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1789081769.309850:0:14103:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789081769.309851:0:14103:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789081769.309852:0:14103:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789081769.309853:0:14103:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789081769.309855:0:14103:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789081769.309855:0:14103:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789081769.309856:0:14103:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789081769.309857:0:14103:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789081769.309858:0:14103:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789081769.309859:0:14103:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789081769.309883:0:14103:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789081769.309900:0:14103:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14103:1875987821320832:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789081769.309954:0:14103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081769.309995:0:14103:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d0f18e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789081769.310054:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821320832 00000100:00100000:0.0:1789081769.310060:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821320832 00000100:00100000:0.0:1789081769.310102:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789081769.310110:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+12:14103:x1875987821320832:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789081769.310137:0:14115:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789081769.310148:0:14115:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789081769.371747:0:14115:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789081769.371769:0:14115:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1789081769.372405:0:14137:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789081769.372411:0:14137:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789081769.372437:0:14137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e10d1bd1c00/0xb7cb3d7479d60822 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081769.372457:0:14137:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e1101999c00/0xb7cb3d7479d607f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d607ea expref: 12 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081769.372466:0:14137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e10d1bd1c00/0xb7cb3d7479d60822 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081769.372504:0:14137:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e1101999c00/0xb7cb3d7479d607f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb7cb3d7479d607ea expref: 12 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081769.372519:0:14137:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e1101999c00/0xb7cb3d7479d607f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb7cb3d7479d607ea expref: 12 pid: 14116 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081769.372562:0:14137:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14137:1875987821320960:0@lo:104: 00000100:00100000:1.0:1789081769.372628:0:14137:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081769.372672:0:14137:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d0f9c480 going to sleep for 11 seconds 00000100:00100000:2.0:1789081769.372780:0:14104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821320960 00000100:00100000:2.0:1789081769.372787:0:14104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821320960 00000100:00100000:2.0:1789081769.372837:0:14104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789081769.372847:0:14104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10fada4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+3:14137:x1875987821320960:12345-0@lo:104: 00010000:00010000:2.0:1789081769.372859:0:14104:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0600/0xb7cb3d7479d607ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d607f1 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081769.372915:0:14104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789081769.372921:0:14104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10fada4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+3:14137:x1875987821320960:12345-0@lo:104: Request processed in 77us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081769.372942:0:14104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789081769.372963:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789081769.372969:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0600/0xb7cb3d7479d607ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d607f1 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081769.372977:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10d1bd0600 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:2.0:1789081769.372981:0:14110:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0600/0xb7cb3d7479d607ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb7cb3d7479d607f1 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081769.372990:0:14110:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0600/0xb7cb3d7479d607ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb7cb3d7479d607f1 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789081769.372997:0:14110:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0600/0xb7cb3d7479d607ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb7cb3d7479d607f1 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789081769.373106:0:14110:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789081769.373133:0:14110:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0600/0xb7cb3d7479d607ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d607f1 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081769.373140:0:14110:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789081769.373158:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0600/0xb7cb3d7479d607ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d607f1 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081769.373164:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0600/0xb7cb3d7479d607ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d607f1 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081769.373249:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081769.373251:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081769.373253:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789081769.373276:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:3306:1875987821321088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789081769.373312:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081769.373396:0:14106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821321088 00000100:00100000:2.0:1789081769.373400:0:14106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821321088 00010000:00010000:2.0:1789081769.373417:0:14106:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e1101999c00/0xb7cb3d7479d607f1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d607ea expref: 13 pid: 14116 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081769.373439:0:14106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789081769.373445:0:14106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+13:3306:x1875987821321088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789081769.373455:0:14106:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789081769.373461:0:14106:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e1101999c00/0xb7cb3d7479d607f1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d607ea expref: 13 pid: 14116 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081769.373471:0:14106:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e1101999c00/0xb7cb3d7479d607f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb7cb3d7479d607ea expref: 13 pid: 14116 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081769.373487:0:14106:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e10d1bd1c00/0xb7cb3d7479d60822 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081769.373495:0:14106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10d1bd1c00/0xb7cb3d7479d60822 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789081769.373508:0:14106:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001098167s 00010000:00010000:2.0:1789081769.373513:0:14106:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e10d1bd1c00/0xb7cb3d7479d60822 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081769.373519:0:14106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e10d1bd1c00/0xb7cb3d7479d60822 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081769.373557:0:14106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e10d1bd1c00/0xb7cb3d7479d60822 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081769.373574:0:14106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e10d1bd1c00/0xb7cb3d7479d60822 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081769.373579:0:14106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10d1bd1c00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:2.0:1789081769.373584:0:14106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e10d1bd1c00/0xb7cb3d7479d60822 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081769.373591:0:14106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e10d1bd1c00/0xb7cb3d7479d60822 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081769.373600:0:14106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e10d1bd1c00/0xb7cb3d7479d60822 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081769.373610:0:14106:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789081769.373635:0:14106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+13:3306:x1875987821321088:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081769.373641:0:14106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789081769.373672:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:3306:1875987821321088:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789081769.373743:0:14137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e1101999c00/0xb7cb3d7479d607f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb7cb3d7479d607ea expref: 12 pid: 14116 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081769.373753:0:14137:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14137:1875987821320960:0@lo:104: 00010000:00010000:3.0:1789081769.373764:0:14137:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e10d1bd1c00/0xb7cb3d7479d60822 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081769.373772:0:14137:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e10d1bd1c00/0xb7cb3d7479d60822 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081769.373779:0:14137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e10d1bd1c00/0xb7cb3d7479d60822 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081769.373785:0:14137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10d1bd1c00/0xb7cb3d7479d60822 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081769.381719:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+11:14103:x1875987821320832:12345-0@lo:253:mount.lustre.0 Request processed in 71602us (71757us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081769.381734:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789081769.381817:0:14103:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14103:1875987821320832:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789081769.381833:0:14103:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789081769.381837:0:14103:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789081769.381839:0:14103:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789081769.381840:0:14103:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789081769.381841:0:14103:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789081769.381842:0:14103:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789081769.381854:0:14103:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789081769.381855:0:14103:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789081769.381857:0:14103:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789081769.381858:0:14103:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789081769.381860:0:14103:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789081769.381875:0:14103:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789081769.387430:0:14103:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1789081769.387675:0:14103:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789081769.387941:0:14103:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1789081769.388269:0:14103:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789081769.388689:0:14103:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1789081769.388848:0:14103:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1789081769.390296:0:14103:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1789081769.390476:0:14103:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1789081769.390800:0:14103:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1789081769.391017:0:14103:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1789081769.391857:0:14103:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1789081769.392016:0:14103:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1789081769.414095:0:14103:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1789081769.414597:0:14103:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1789081769.414747:0:14159:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1789081769.414750:0:14159:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1789081769.415269:0:14160:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1789081769.415347:0:14160:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789081769.418676:0:14160:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789081769.418746:0:14160:0:(lod_dev.c:522:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789081769.418750:0:14160:0:(lod_dev.c:546:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:3.0:1789081769.421903:0:14103:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789081769.422030:0:14103:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789081769.422969:0:14103:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789081769.422981:0:14103:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789081769.423497:0:14103:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789081769.424907:0:14103:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789081769.425674:0:14103:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789081769.425713:0:14103:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1789081769.427631:0:14103:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1789081769.435696:0:14103:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1789081769.467291:0:14103:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789081769.467336:0:14103:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffadf201c4b988 00100000:10000000:2.0:1789081769.467344:0:14103:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789081769.470823:0:14103:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789081769.470843:0:14103:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.117@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789081769.470857:0:14103:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1789081769.470881:0:14103:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1789081769.886658:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789081770.334330:0:14155:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1789081770.525596:0:14118:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789081770.525606:0:14118:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e10ff613800 from 6 10000000:01000000:1.0:1789081770.525612:0:14118:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789081770.525667:0:14118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0400/0xb7cb3d7479d60829 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081770.525681:0:14118:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0400/0xb7cb3d7479d60829 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081770.525693:0:14118:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0400/0xb7cb3d7479d60829 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081770.525743:0:14118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14118:1875987821321216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789081770.525826:0:14118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081770.525867:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821321216 00000100:00100000:0.0:1789081770.525879:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821321216 00000100:00100000:1.0:1789081770.525884:0:14118:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10f5dfa600 going to sleep for 11 seconds 00000100:00100000:0.0:1789081770.525950:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789081770.525962:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+11:14118:x1875987821321216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789081770.525979:0:14114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081770.525997:0:14114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e1101983400/0xb7cb3d7479d60830 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d60829 expref: -99 pid: 14114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081770.526023:0:14114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e1101983400/0xb7cb3d7479d60830 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d60829 expref: 12 pid: 14114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081770.526035:0:14114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e1101983400/0xb7cb3d7479d60830 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d60829 expref: 12 pid: 14114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081770.526046:0:14114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101983400, rc 0) 00000100:00100000:0.0:1789081770.526096:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+12:14118:x1875987821321216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081770.526103:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789081770.526191:0:14118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14118:1875987821321216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789081770.526205:0:14118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0400/0xb7cb3d7479d60829 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d60830 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081770.526212:0:14118:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0400/0xb7cb3d7479d60829 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d60830 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081770.526249:0:14118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14118:1875987821321344:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789081770.526270:0:14118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081770.526286:0:14118:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10f5dfa600 going to sleep for 11 seconds 00000100:00100000:2.0:1789081770.526367:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821321344 00000100:00100000:2.0:1789081770.526378:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821321344 00000100:00100000:2.0:1789081770.526414:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789081770.526421:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+12:14118:x1875987821321344:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789081770.526435:0:14115:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789081770.526450:0:14115:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789081770.526453:0:14115:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1789081770.526683:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+12:14118:x1875987821321344:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 263us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081770.526691:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789081770.526803:0:14118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14118:1875987821321344:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789081770.526835:0:14118:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789081770.526840:0:14118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0400/0xb7cb3d7479d60829 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d60830 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081770.526846:0:14118:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0400/0xb7cb3d7479d60829 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d60830 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081770.913492:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789081771.357920:0:14155:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789081771.935515:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081772.962825:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789081773.798882:0:14403:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg117-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789081773.980878:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789081774.430650:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789081774.430657:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789081774.430660:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789081774.430662:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789081774.430665:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789081774.430668:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789081774.430672:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e10e7c10000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789081774.430683:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e10e7c10000 using connection 192.168.201.117@tcp/0@lo 00000100:00100000:3.0:1789081774.430705:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e10f5c02300 x1875987821321600/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789081774.430760:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789081774.430772:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:3304:1875987821321472:0@lo:400:kworker.0 00000100:00100000:3.0:1789081774.430880:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081774.431222:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875987821321600:0@lo:38:kworker.0 00000100:00100000:3.0:1789081774.431325:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081774.431457:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821321472 00000100:00100000:3.0:1789081774.431466:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821321472 00000100:00100000:3.0:1789081774.431595:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789081774.431605:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+12:3304:x1875987821321472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081774.431662:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+12:3304:x1875987821321472:12345-0@lo:400:kworker.0 Request processed in 58us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081774.431669:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789081774.431837:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:3304:1875987821321472:0@lo:400:kworker.0 00000100:00100000:2.0:1789081774.431952:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821321600 00000100:00100000:2.0:1789081774.431958:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821321600 00000100:00100000:2.0:1789081774.432122:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789081774.432128:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1875987821321600:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1789081774.432149:0:14123:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 441 last 0 00000020:00000080:2.0:1789081774.432182:0:14123:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xb7cb3d7479d60837 00000004:00100000:2.0:1789081774.432199:0:14123:0:(mdt_handler.c:7406:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789081774.432351:0:14123:0:(import.c:65:import_set_state_nolock()) ffff9e10ffa8b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789081774.432556:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875987821321600:12345-0@lo:38:kworker.0 Request processed in 426us (1229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081774.432563:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789081774.432633:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e10f5c02300 x1875987821321600/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789081784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789081774.432649:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789081774.432656:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789081774.432662:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789081774.432664:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e10e7c10000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789081774.432670:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875987821321600:0@lo:38:kworker.0 00010000:00010000:2.0:1789081775.005056:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081776.032318:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789081776.352281:0:14554:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe48e477b0 20000000:00000080:1.0:1789081776.352298:0:14554:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e10fb51e800 uarg=0000000000000000 20000000:01000000:1.0:1789081776.352403:0:14554:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789081776.352412:0:14554:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789081776.352416:0:14554:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789081776.353343:0:14555:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1789081776.353498:0:14554:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789081776.361448:0:14554:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789081776.361564:0:14554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e1101983a00/0xb7cb3d7479d6083e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081776.361583:0:14554:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e1101774c00/0xb7cb3d7479d607ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d607f8 expref: 11 pid: 14114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081776.361592:0:14554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e1101983a00/0xb7cb3d7479d6083e lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081776.361642:0:14554:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e1101774c00/0xb7cb3d7479d607ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb7cb3d7479d607f8 expref: 11 pid: 14114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081776.361671:0:14554:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e1101774c00/0xb7cb3d7479d607ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb7cb3d7479d607f8 expref: 11 pid: 14114 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081776.361687:0:14554:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b24a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14554:1875987821321728:0@lo:104: 00000100:00100000:0.0:1789081776.361756:0:14554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081776.361810:0:14554:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d106d900 going to sleep for 11 seconds 00000100:00100000:1.0:1789081776.362047:0:14105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821321728 00000100:00100000:1.0:1789081776.362126:0:14105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821321728 00000100:00100000:1.0:1789081776.362180:0:14105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789081776.362191:0:14105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+3:14554:x1875987821321728:12345-0@lo:104: 00010000:00010000:1.0:1789081776.362211:0:14105:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd1a00/0xb7cb3d7479d607f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d607ff expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081776.362290:0:14105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789081776.362296:0:14105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+3:14554:x1875987821321728:12345-0@lo:104: Request processed in 108us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081776.362304:0:14105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1789081776.362306:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789081776.362313:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd1a00/0xb7cb3d7479d607f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d607ff expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081776.362331:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10d1bd1a00 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:2.0:1789081776.362335:0:14110:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd1a00/0xb7cb3d7479d607f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb7cb3d7479d607ff expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081776.362344:0:14110:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd1a00/0xb7cb3d7479d607f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb7cb3d7479d607ff expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789081776.362351:0:14110:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd1a00/0xb7cb3d7479d607f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb7cb3d7479d607ff expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789081776.362356:0:14110:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789081776.362393:0:14110:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd1a00/0xb7cb3d7479d607f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d607ff expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081776.362400:0:14110:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789081776.362429:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd1a00/0xb7cb3d7479d607f8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d607ff expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081776.362437:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd1a00/0xb7cb3d7479d607f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d607ff expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081776.362451:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081776.362453:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:3304:1875987821321856:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789081776.362453:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081776.362454:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081776.362488:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081776.362515:0:14554:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b24a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14554:1875987821321728:0@lo:104: 00010000:00010000:0.0:1789081776.362551:0:14554:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e1101983a00/0xb7cb3d7479d6083e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081776.362609:0:14106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821321856 00000100:00100000:2.0:1789081776.362614:0:14106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821321856 00010000:00010000:2.0:1789081776.362633:0:14106:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e1101774c00/0xb7cb3d7479d607ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d607f8 expref: 12 pid: 14114 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081776.362648:0:14106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789081776.362657:0:14106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+12:3304:x1875987821321856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789081776.362665:0:14106:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789081776.362668:0:14106:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e1101774c00/0xb7cb3d7479d607ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d607f8 expref: 12 pid: 14114 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081776.362675:0:14106:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e1101774c00/0xb7cb3d7479d607ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb7cb3d7479d607f8 expref: 12 pid: 14114 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081776.362688:0:14106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e1101774c00/0xb7cb3d7479d607ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb7cb3d7479d607f8 expref: 12 pid: 14114 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081776.362700:0:14106:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e1101983a00/0xb7cb3d7479d6083e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081776.362708:0:14106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e1101983a00/0xb7cb3d7479d6083e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081776.362721:0:14106:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e1101983a00/0xb7cb3d7479d6083e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081776.362728:0:14106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e1101983a00/0xb7cb3d7479d6083e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081776.362735:0:14106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e1101983a00/0xb7cb3d7479d6083e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081776.362742:0:14106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e1101983a00/0xb7cb3d7479d6083e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081776.362745:0:14106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101983a00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:2.0:1789081776.362749:0:14106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e1101983a00/0xb7cb3d7479d6083e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081776.362763:0:14106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e1101983a00/0xb7cb3d7479d6083e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081776.362784:0:14106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e1101983a00/0xb7cb3d7479d6083e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081776.362794:0:14106:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789081776.362822:0:14554:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e1101983a00/0xb7cb3d7479d6083e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081776.362830:0:14106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+11:3304:x1875987821321856:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (341us total) trans 0 rc 0/0 00010000:00010000:1.0:1789081776.362831:0:14554:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e1101983a00/0xb7cb3d7479d6083e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081776.362837:0:14106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1789081776.362837:0:14554:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e1101983a00/0xb7cb3d7479d6083e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081776.362905:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:3304:1875987821321856:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789081777.053096:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081778.079050:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789081778.268710:0:14118:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789081778.268721:0:14118:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e10ff613800 from 10 10000000:01000000:1.0:1789081778.268728:0:14118:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789081778.268804:0:14118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd1a00/0xb7cb3d7479d60845 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081778.268817:0:14118:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd1a00/0xb7cb3d7479d60845 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081778.268830:0:14118:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd1a00/0xb7cb3d7479d60845 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081778.268867:0:14118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14118:1875987821321984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789081778.268997:0:14118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081778.269163:0:14118:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10f97fc180 going to sleep for 11 seconds 00000100:00100000:0.0:1789081778.270823:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821321984 00000100:00100000:0.0:1789081778.270838:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821321984 00000100:00100000:0.0:1789081778.270908:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789081778.270919:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+11:14118:x1875987821321984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789081778.270942:0:14116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081778.270966:0:14116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e1101983200/0xb7cb3d7479d6084c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d60845 expref: -99 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081778.270999:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e1101983200/0xb7cb3d7479d6084c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d60845 expref: 12 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081778.271012:0:14116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e1101983200/0xb7cb3d7479d6084c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d60845 expref: 12 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081778.271029:0:14116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101983200, rc 0) 00000100:00100000:0.0:1789081778.271133:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+12:14118:x1875987821321984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 215us (2141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081778.271159:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789081778.271702:0:14118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14118:1875987821321984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789081778.271726:0:14118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd1a00/0xb7cb3d7479d60845 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d6084c expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081778.271737:0:14118:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd1a00/0xb7cb3d7479d60845 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d6084c expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081778.271832:0:14118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c00e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14118:1875987821322112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789081778.271876:0:14118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081778.272444:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821322112 00000100:00100000:0.0:1789081778.272452:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821322112 00000100:00100000:0.0:1789081778.272502:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789081778.272511:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+12:14118:x1875987821322112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789081778.272899:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+12:14118:x1875987821322112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 388us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081778.272907:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789081778.280860:0:14118:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c4da4540 going to sleep for 11 seconds 00000100:00100000:3.0:1789081778.280932:0:14118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c00e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14118:1875987821322112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789081778.281260:0:14118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c00e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14118:1875987821322240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789081778.281378:0:14118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081778.281426:0:14118:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c4da4540 going to sleep for 11 seconds 00000100:00100000:1.0:1789081778.281555:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821322240 00000100:00100000:1.0:1789081778.281566:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821322240 00000100:00100000:1.0:1789081778.281645:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789081778.281656:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+12:14118:x1875987821322240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789081778.281923:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+12:14118:x1875987821322240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 266us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081778.281931:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789081778.282410:0:14118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c00e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14118:1875987821322240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789081778.292317:0:14634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1789081778.292690:0:14118:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1789081778.292717:0:14118:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789081778.292733:0:14118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd1a00/0xb7cb3d7479d60845 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d6084c expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081778.292748:0:14118:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd1a00/0xb7cb3d7479d60845 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d6084c expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081779.110385:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789081779.548698:0:3302:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789081769/real 1789081769] req@ffff9e10f5c01180 x1875987821318912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789081779 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081779.548728:0:3302:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e10f5c01180 x1875987821318912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789081779 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081779.548740:0:3302:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789081769/real 1789081769] req@ffff9e10f5c01f80 x1875987821318784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789081779 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081779.548751:0:3302:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e10f5c01f80 x1875987821318784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789081779 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789081779.548770:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e10ff77b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789081779.548793:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789081779.548797:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875987821318912:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1789081779.548847:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:3305:1875987821322368:0@lo:400:kworker.0 00000100:00100000:3.0:1789081779.548919:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789081779.549065:0:491:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789081779.549071:0:491:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789081779.549074:0:491:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789081779.549077:0:491:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789081779.549080:0:491:0:(import.c:65:import_set_state_nolock()) ffff9e10ff77b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789081779.549086:0:491:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 436 00000100:00080000:2.0:1789081779.549091:0:491:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789081779.549101:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e10f97e8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789081779.549110:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789081779.549114:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875987821318784:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789081779.549181:0:491:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e10ff77b000 using connection 192.168.201.117@tcp/0@lo 00000100:00100000:3.0:1789081779.549182:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821322368 00000100:00100000:3.0:1789081779.549202:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821322368 00000100:00100000:2.0:1789081779.549498:0:491:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e10d2dc0700 x1875987821322496/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789081779.549573:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789081779.549583:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+12:3305:x1875987821322368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081779.549641:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+12:3305:x1875987821322368:12345-0@lo:400:kworker.0 Request processed in 59us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081779.549660:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789081779.549712:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:3305:1875987821322368:0@lo:400:kworker.0 00000100:00080000:2.0:1789081779.549846:0:491:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789081779.549851:0:491:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789081779.549853:0:491:0:(import.c:65:import_set_state_nolock()) ffff9e10f97e8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789081779.549858:0:491:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 436 00000100:00080000:2.0:1789081779.549862:0:491:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789081779.549865:0:491:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e10f97e8800 using connection 192.168.201.117@tcp/0@lo 00000100:00100000:2.0:1789081779.549881:0:491:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e10d2dc2a00 x1875987821322752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789081779.549903:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875987821322624:0@lo:400:kworker.0 00000100:00100000:2.0:1789081779.549947:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081779.549999:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821322624 00000100:00100000:1.0:1789081779.550005:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821322624 00000100:00100000:1.0:1789081779.550044:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789081779.550051:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875987821322624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081779.550100:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875987821322624:12345-0@lo:400:kworker.0 Request processed in 49us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081779.550106:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789081779.550184:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e10d2dc0000 x1875987821322624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789081795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789081779.550207:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875987821322624:0@lo:400:kworker.0 00000100:00100000:0.0:1789081779.551413:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875987821322496:0@lo:8:kworker.0 00000400:00000100:0.0:1789081779.551469:0:3302:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875987821322496 offset 0 length 520: 4 00000100:00100000:0.0:1789081779.551783:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875987821322752:0@lo:8:kworker.0 00000400:00000100:0.0:1789081779.551811:0:3302:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875987821322752 offset 0 length 520: 4 00010000:00010000:1.0:1789081780.128916:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789081780.681074:0:14755:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789081780.681079:0:14755:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1789081780.681206:0:14755:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9e10f98e2800 00000020:01000004:2.0:1789081780.681225:0:14755:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789081780.681240:0:14755:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789081780.681254:0:14755:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9e10ff7d0000) 00000020:00000080:2.0:1789081780.681271:0:14755:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789081780.720062:0:14755:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789081780.725001:0:14755:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789081780.729388:0:14755:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789081780.730155:0:14755:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789081780.732134:0:14755:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789081780.734995:0:14755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:2.0:1789081780.735128:0:14755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:2.0:1789081780.736142:0:14755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:2.0:1789081780.738859:0:14755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 653: rc = 0 00100000:10000000:2.0:1789081780.739316:0:14755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 653: rc = 0 00100000:10000000:2.0:1789081780.739659:0:14755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 653: rc = 0 00100000:10000000:2.0:1789081780.740438:0:14755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 653: rc = 0 00100000:10000000:2.0:1789081780.740954:0:14755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 653: rc = 0 00100000:10000000:2.0:1789081780.741355:0:14755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 653: rc = 0 00000020:00000080:2.0:1789081780.744699:0:14755:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789081780.744715:0:14755:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789081780.744728:0:14755:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb7cb3d7479d6085a 00000020:01000004:2.0:1789081780.744736:0:14755:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1789081780.744760:0:14755:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.117@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789081780.744764:0:14755:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.117@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789081780.744770:0:14755:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789081780.744775:0:14755:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789081780.744789:0:14755:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9e10d1a03380) 00000020:00000080:2.0:1789081780.744799:0:14755:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1789081780.752516:0:14755:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789081780.752757:0:14755:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789081780.752767:0:14755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789081780.754784:0:14755:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789081780.754798:0:14755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789081780.760520:0:14755:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789081780.760563:0:14755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789081780.780106:0:14755:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789081780.780347:0:14755:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789081780.780353:0:14755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789081780.781416:0:14755:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789081780.781426:0:14755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1789081780.828844:0:14755:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789081780.829075:0:14755:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789081780.829082:0:14755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789081780.830297:0:14755:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789081780.830379:0:14755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789081780.833228:0:14755:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789081780.833242:0:14755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789081780.841807:0:14755:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789081780.842280:0:14755:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789081780.842287:0:14755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789081780.843130:0:14755:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789081780.843140:0:14755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789081780.900488:0:14755:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789081780.901154:0:14755:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789081780.901164:0:14755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789081780.902812:0:14755:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789081780.902826:0:14755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789081780.903318:0:14755:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789081780.903343:0:14755:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1789081780.903350:0:14755:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.117@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789081780.914072:0:14755:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.117@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789081780.914206:0:14755:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.117@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1789081780.914212:0:14755:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789081780.914214:0:14755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789081780.914215:0:14755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789081780.914216:0:14755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789081780.914218:0:14755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789081780.914219:0:14755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789081780.914221:0:14755:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789081780.914223:0:14755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789081780.914225:0:14755:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789081780.914229:0:14755:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1789081780.914232:0:14755:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789081780.914233:0:14755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789081780.914235:0:14755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789081780.914236:0:14755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789081780.914237:0:14755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789081780.914238:0:14755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789081780.914239:0:14755:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789081780.914240:0:14755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789081780.914241:0:14755:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789081780.914271:0:14755:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789081780.914300:0:14755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14755:1875987821322880:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789081780.914389:0:14755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081780.914655:0:14755:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d0f18540 going to sleep for 11 seconds 00000100:00100000:1.0:1789081780.914767:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821322880 00000100:00100000:1.0:1789081780.914775:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821322880 00000100:00100000:1.0:1789081780.914870:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789081780.914880:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+12:14755:x1875987821322880:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789081780.914930:0:14114:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789081780.914933:0:14114:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1789081780.914938:0:14114:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789081780.924787:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+12:14755:x1875987821322880:12345-0@lo:253:mount.lustre.0 Request processed in 9900us (10389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081780.924803:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789081780.924898:0:14755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14755:1875987821322880:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789081780.924914:0:14755:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789081780.924917:0:14755:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789081780.924919:0:14755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789081780.924920:0:14755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789081780.924922:0:14755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789081780.924923:0:14755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789081780.924924:0:14755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789081780.924926:0:14755:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789081780.924928:0:14755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789081780.924929:0:14755:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789081780.924950:0:14755:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e10f98e2800 from lustre-OST0000 10000000:01000000:0.0:1789081780.925036:0:14755:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789081780.925039:0:14755:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789081780.925046:0:14755:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e10ff7d19c0 local copy 00010000:00010000:0.0:1789081780.925059:0:14755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0200/0xb7cb3d7479d60750 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d60757 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081780.925393:0:14755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14755:1875987821323008:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789081780.925517:0:14755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081780.925644:0:14755:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d0f18a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789081780.925733:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821323008 00000100:00100000:3.0:1789081780.925741:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821323008 00000100:00100000:3.0:1789081780.925845:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789081780.925856:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+12:14755:x1875987821323008:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789081780.926252:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+12:14755:x1875987821323008:12345-0@lo:501:mount.lustre.0 Request processed in 396us (734us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789081780.926261:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789081780.926339:0:14755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14755:1875987821323008:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789081780.926357:0:14755:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.117@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789081780.926512:0:14755:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.117@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789081780.926520:0:14755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0200/0xb7cb3d7479d60750 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d60757 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081780.926574:0:14755:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0200/0xb7cb3d7479d60750 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d60757 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789081780.926598:0:14755:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e10f98e2800 10000000:01000000:0.0:1789081780.926604:0:14755:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789081780.926609:0:14755:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9e10ff7d19c0 10000000:01000000:0.0:1789081780.926612:0:14755:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1789081780.926616:0:14755:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9e10ff7d19c0 from 1 10000000:01000000:0.0:1789081780.926619:0:14755:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789081780.926652:0:14755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101982a00/0xb7cb3d7479d60868 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081780.926661:0:14755:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e1101982a00/0xb7cb3d7479d60868 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081780.926670:0:14755:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e1101982a00/0xb7cb3d7479d60868 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081780.926687:0:14755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14755:1875987821323136:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789081780.926718:0:14755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081780.926949:0:14755:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d0f18a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789081780.927138:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821323136 00000100:00100000:2.0:1789081780.927145:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821323136 00000100:00100000:2.0:1789081780.927184:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789081780.927192:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+12:14755:x1875987821323136:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789081780.927213:0:14115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081780.927228:0:14115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e1101774200/0xb7cb3d7479d6086f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d60868 expref: -99 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081780.927251:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e1101774200/0xb7cb3d7479d6086f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d60868 expref: 13 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081780.927261:0:14115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e1101774200/0xb7cb3d7479d6086f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d60868 expref: 13 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081780.927270:0:14115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101774200, rc 0) 00000100:00100000:2.0:1789081780.927313:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+13:14755:x1875987821323136:12345-0@lo:101:mount.lustre.0 Request processed in 122us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081780.927320:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789081780.927409:0:14755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14755:1875987821323136:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789081780.927423:0:14755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e1101982a00/0xb7cb3d7479d60868 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d6086f expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081780.927443:0:14755:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e1101982a00/0xb7cb3d7479d60868 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d6086f expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789081780.927474:0:14755:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789081780.927489:0:14755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101982a00/0xb7cb3d7479d60868 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d6086f expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081780.927496:0:14755:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e1101982a00/0xb7cb3d7479d60868 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d6086f expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789081780.927502:0:14755:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789081780.927506:0:14755:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789081780.927511:0:14755:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789081780.927513:0:14755:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789081780.927553:0:14755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101982200/0xb7cb3d7479d60876 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081780.927560:0:14755:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e1101982200/0xb7cb3d7479d60876 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081780.927566:0:14755:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e1101982200/0xb7cb3d7479d60876 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081780.927579:0:14755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14755:1875987821323264:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789081780.927604:0:14755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081780.927624:0:14755:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d0f18a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789081780.927728:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821323264 00000100:00100000:2.0:1789081780.927733:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821323264 00000100:00100000:2.0:1789081780.927749:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789081780.927754:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+13:14755:x1875987821323264:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789081780.927761:0:14115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081780.927769:0:14115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e1101774a00/0xb7cb3d7479d6087d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d60876 expref: -99 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081780.927782:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e1101774a00/0xb7cb3d7479d6087d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d60876 expref: 14 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081780.927790:0:14115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e1101774a00/0xb7cb3d7479d6087d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d60876 expref: 14 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081780.927796:0:14115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101774a00, rc 0) 00000100:00100000:2.0:1789081780.927842:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+14:14755:x1875987821323264:12345-0@lo:101:mount.lustre.0 Request processed in 86us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081780.927848:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789081780.927918:0:14755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14755:1875987821323264:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789081780.927930:0:14755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e1101982200/0xb7cb3d7479d60876 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d6087d expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081780.927937:0:14755:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e1101982200/0xb7cb3d7479d60876 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d6087d expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789081780.929058:0:14755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1789081780.930377:0:14755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789081780.930919:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1789081780.930966:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1789081780.931197:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1789081780.931252:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1789081780.931293:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1789081780.931346:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1789081780.931418:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1789081780.931427:0:14755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1789081780.931722:0:14755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14755:1875987821323392:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789081780.931786:0:14755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081780.931881:0:14755:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d0f183c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789081780.932047:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821323392 00000100:00100000:2.0:1789081780.932056:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821323392 00000100:00100000:2.0:1789081780.932218:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789081780.932229:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+14:14755:x1875987821323392:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789081780.932687:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+14:14755:x1875987821323392:12345-0@lo:501:mount.lustre.0 Request processed in 459us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081780.932695:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789081780.932800:0:14755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14755:1875987821323392:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789081780.932842:0:14755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14755:1875987821323520:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789081780.932884:0:14755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081780.933198:0:14755:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d0f183c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789081780.933283:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821323520 00000100:00100000:3.0:1789081780.933289:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821323520 00000100:00100000:3.0:1789081780.933317:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789081780.933325:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+14:14755:x1875987821323520:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789081780.934629:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+14:14755:x1875987821323520:12345-0@lo:503:mount.lustre.0 Request processed in 1299us (1738us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081780.934641:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789081780.934843:0:14755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14755:1875987821323520:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789081780.935607:0:14755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789081780.935684:0:14755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14755:1875987821323648:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789081780.935749:0:14755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081780.935784:0:14755:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d0f183c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789081780.935921:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821323648 00000100:00100000:2.0:1789081780.935929:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821323648 00000100:00100000:2.0:1789081780.935967:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789081780.936046:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+14:14755:x1875987821323648:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789081780.936353:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+14:14755:x1875987821323648:12345-0@lo:502:mount.lustre.0 Request processed in 309us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081780.936361:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789081780.936667:0:14755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14755:1875987821323648:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789081780.936925:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1789081780.937156:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1789081780.937215:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1789081780.937267:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1789081780.937305:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1789081780.937337:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1789081780.937385:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1789081780.937420:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1789081780.937627:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1789081780.937672:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1789081780.937705:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1789081780.937771:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1789081780.937814:0:14755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14755:1875987821323776:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789081780.937884:0:14755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081780.937987:0:14755:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d0f183c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789081780.938142:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821323776 00000100:00100000:2.0:1789081780.938151:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821323776 00000100:00100000:2.0:1789081780.938257:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789081780.938268:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+14:14755:x1875987821323776:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789081780.938485:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+14:14755:x1875987821323776:12345-0@lo:502:mount.lustre.0 Request processed in 219us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081780.938493:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789081780.938616:0:14755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14755:1875987821323776:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789081780.938687:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1789081780.938697:0:14755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1789081780.940314:0:14769:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789081780.940328:0:14769:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1789081780.940336:0:14769:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789081780.940345:0:14769:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789081780.940351:0:14769:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789081780.940367:0:14769:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9e10d1a04d40) 00000020:00000080:2.0:1789081780.940392:0:14769:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789081780.940397:0:14769:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789081780.945247:0:14769:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e10f98e2800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789081780.945263:0:14769:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789081780.945275:0:14769:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb7cb3d7479d6088b 00010000:00010000:2.0:1789081780.950803:0:14769:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1789081780.951384:0:14769:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1789081780.954316:0:14769:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1789081780.957036:0:14769:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789081780.957051:0:14769:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789081780.957058:0:14769:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789081780.957060:0:14769:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789081780.957063:0:14769:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789081780.957065:0:14769:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1789081780.957067:0:14769:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789081780.957068:0:14769:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789081780.957070:0:14769:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789081780.957209:0:14769:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789081780.957212:0:14769:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789081780.957217:0:14769:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789081780.957222:0:14769:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789081780.957224:0:14769:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789081780.957227:0:14769:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789081780.957229:0:14769:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789081780.957231:0:14769:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789081780.957233:0:14769:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789081780.957234:0:14769:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789081780.957237:0:14769:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789081780.957239:0:14769:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789081780.957240:0:14769:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789081780.957243:0:14769:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789081780.957316:0:14769:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789081780.957320:0:14769:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789081780.957322:0:14769:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789081780.957325:0:14769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1789081780.957613:0:14755:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1789081780.957641:0:14755:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789081780.957663:0:14755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101982200/0xb7cb3d7479d60876 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d6087d expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081780.957675:0:14755:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e1101982200/0xb7cb3d7479d60876 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d6087d expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789081780.957684:0:14755:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e10f98e2800 from 1 10000000:01000000:2.0:1789081780.957687:0:14755:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789081780.957727:0:14755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101774800/0xb7cb3d7479d60892 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081780.957735:0:14755:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e1101774800/0xb7cb3d7479d60892 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081780.957747:0:14755:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e1101774800/0xb7cb3d7479d60892 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081780.957776:0:14755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14755:1875987821323904:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789081780.957856:0:14755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081780.957903:0:14755:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c52e4180 going to sleep for 11 seconds 00000100:00100000:1.0:1789081780.959958:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821323904 00000100:00100000:1.0:1789081780.959973:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821323904 00000100:00100000:1.0:1789081780.960030:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789081780.960041:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+14:14755:x1875987821323904:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789081780.960058:0:14114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081780.960078:0:14114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10d1bd0e00/0xb7cb3d7479d60899 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d60892 expref: -99 pid: 14114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081780.960109:0:14114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10d1bd0e00/0xb7cb3d7479d60899 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d60892 expref: 15 pid: 14114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081780.960120:0:14114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10d1bd0e00/0xb7cb3d7479d60899 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d60892 expref: 15 pid: 14114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081780.960129:0:14114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10d1bd0e00, rc 0) 00000100:00100000:1.0:1789081780.960222:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+15:14755:x1875987821323904:12345-0@lo:101:mount.lustre.0 Request processed in 183us (2366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081780.960230:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789081780.960604:0:14755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14755:1875987821323904:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789081780.960624:0:14755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e1101774800/0xb7cb3d7479d60892 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d60899 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081780.960635:0:14755:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e1101774800/0xb7cb3d7479d60892 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d60899 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789081780.961273:0:14755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789081780.961934:0:14755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789081780.962223:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1789081780.962267:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1789081780.962325:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1789081780.962334:0:14755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1789081780.962410:0:14755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14755:1875987821324032:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789081780.962476:0:14755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081780.962560:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821324032 00000100:00100000:2.0:1789081780.962566:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821324032 00000100:00100000:2.0:1789081780.962615:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789081780.962624:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+15:14755:x1875987821324032:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789081780.962807:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+15:14755:x1875987821324032:12345-0@lo:501:mount.lustre.0 Request processed in 184us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081780.962816:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789081780.962864:0:14755:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c52e4180 going to sleep for 11 seconds 00000100:00100000:2.0:1789081780.962885:0:14755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14755:1875987821324032:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789081780.962916:0:14755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14755:1875987821324160:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789081780.962956:0:14755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081780.962983:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821324160 00000100:00100000:2.0:1789081780.962986:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821324160 00000100:00100000:2.0:1789081780.963001:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789081780.963007:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+15:14755:x1875987821324160:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789081780.963137:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+15:14755:x1875987821324160:12345-0@lo:503:mount.lustre.0 Request processed in 129us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081780.963144:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789081780.963184:0:14755:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c52e4180 going to sleep for 11 seconds 00000100:00100000:2.0:1789081780.963197:0:14755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14755:1875987821324160:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789081780.963633:0:14755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789081780.963686:0:14755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14755:1875987821324288:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789081780.963726:0:14755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081780.963754:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821324288 00000100:00100000:2.0:1789081780.963758:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821324288 00000100:00100000:2.0:1789081780.963779:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789081780.963786:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+15:14755:x1875987821324288:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789081780.963925:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+15:14755:x1875987821324288:12345-0@lo:502:mount.lustre.0 Request processed in 139us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081780.963934:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789081780.963976:0:14755:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d2d159c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789081780.963993:0:14755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14755:1875987821324288:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789081780.965189:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789081780.965264:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789081780.965314:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789081780.965376:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789081780.965411:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789081780.976728:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789081780.976856:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789081780.976891:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1789081780.976948:0:14755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14755:1875987821324416:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789081780.978281:0:14755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081780.978337:0:14755:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d2d159c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789081780.978423:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821324416 00000100:00100000:0.0:1789081780.978443:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821324416 00000100:00100000:0.0:1789081780.978503:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789081780.978515:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+15:14755:x1875987821324416:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789081780.978782:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+15:14755:x1875987821324416:12345-0@lo:502:mount.lustre.0 Request processed in 270us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081780.978791:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789081780.979187:0:14755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14755:1875987821324416:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789081780.979355:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1789081780.979372:0:14755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1789081780.982420:0:14773:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789081780.985211:0:14773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789081780.985217:0:14773:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789081780.985234:0:14773:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e10f98e2800 00000020:00000080:2.0:1789081780.985237:0:14773:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789081780.985247:0:14773:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789081780.985250:0:14773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789081780.985251:0:14773:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789081780.985254:0:14773:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789081780.985256:0:14773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789081780.985257:0:14773:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789081780.985260:0:14773:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e10f98e2800 00000020:00000080:2.0:1789081780.985262:0:14773:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789081780.993142:0:14773:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789081780.993159:0:14773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789081780.993161:0:14773:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789081780.993175:0:14773:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789081780.993180:0:14773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789081780.993181:0:14773:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789081780.993187:0:14773:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e10f98e2800 00000020:00000080:2.0:1789081780.993189:0:14773:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789081781.002422:0:14773:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789081781.002462:0:14773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789081781.002465:0:14773:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789081781.002470:0:14773:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1789081781.002825:0:14755:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1789081781.002853:0:14755:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789081781.002876:0:14755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101774800/0xb7cb3d7479d60892 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d60899 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081781.002896:0:14755:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e1101774800/0xb7cb3d7479d60892 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d60899 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789081781.002955:0:14755:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789081781.002960:0:14755:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e10f98e2800 10000000:01000000:2.0:1789081781.002964:0:14755:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e10f98e2800 10000000:01000000:2.0:1789081781.002980:0:14755:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789081781.002988:0:14755:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e10f98e2800 from 1 10000000:01000000:2.0:1789081781.002991:0:14755:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789081781.003040:0:14755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101775800/0xb7cb3d7479d608a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081781.003050:0:14755:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e1101775800/0xb7cb3d7479d608a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081781.003061:0:14755:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e1101775800/0xb7cb3d7479d608a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081781.003102:0:14755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14755:1875987821324544:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789081781.003190:0:14755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081781.003240:0:14755:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d2d159c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789081781.003453:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821324544 00000100:00100000:1.0:1789081781.003461:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821324544 00000100:00100000:1.0:1789081781.003512:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789081781.003543:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+15:14755:x1875987821324544:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789081781.003560:0:14114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081781.003574:0:14114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10d1bd1000/0xb7cb3d7479d608a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d608a0 expref: -99 pid: 14114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081781.003612:0:14114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10d1bd1000/0xb7cb3d7479d608a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d608a0 expref: 16 pid: 14114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081781.003623:0:14114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10d1bd1000/0xb7cb3d7479d608a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d608a0 expref: 16 pid: 14114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081781.003633:0:14114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10d1bd1000, rc 0) 00000100:00100000:1.0:1789081781.003676:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+16:14755:x1875987821324544:12345-0@lo:101:mount.lustre.0 Request processed in 155us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081781.003683:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789081781.004610:0:14755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14755:1875987821324544:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789081781.004636:0:14755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e1101775800/0xb7cb3d7479d608a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d608a7 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081781.004647:0:14755:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e1101775800/0xb7cb3d7479d608a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d608a7 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789081781.005417:0:14755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1789081781.008158:0:14755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789081781.009276:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789081781.009334:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1789081781.009369:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1789081781.009412:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789081781.019254:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789081781.019395:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789081781.020068:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789081781.020118:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789081781.020184:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789081781.020221:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789081781.020270:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789081781.020312:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789081781.020341:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789081781.020389:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789081781.022718:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789081781.022849:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789081781.022885:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1789081781.042196:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1789081781.042317:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1789081781.042357:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1789081781.043764:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1789081781.043841:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1789081781.043877:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1789081781.043927:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1789081781.043961:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1789081781.045192:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1789081781.045261:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1789081781.045289:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1789081781.045367:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1789081781.045374:0:14755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1789081781.046446:0:14755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14755:1875987821324672:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789081781.046544:0:14755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081781.046650:0:14755:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d2d159c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789081781.048763:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821324672 00000100:00100000:1.0:1789081781.048777:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821324672 00000100:00100000:1.0:1789081781.048837:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789081781.048847:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+16:14755:x1875987821324672:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789081781.049149:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+16:14755:x1875987821324672:12345-0@lo:501:mount.lustre.0 Request processed in 303us (2627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081781.049158:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789081781.049333:0:14755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14755:1875987821324672:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789081781.049383:0:14755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14755:1875987821324800:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789081781.049441:0:14755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081781.049479:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821324800 00000100:00100000:2.0:1789081781.049482:0:14755:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d2d159c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789081781.049485:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821324800 00000100:00100000:3.0:1789081781.049520:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789081781.049554:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+16:14755:x1875987821324800:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789081781.049706:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+16:14755:x1875987821324800:12345-0@lo:503:mount.lustre.0 Request processed in 153us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081781.049712:0:14755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14755:1875987821324800:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789081781.049714:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000040:00080000:2.0:1789081781.050686:0:14755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789081781.050770:0:14755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14755:1875987821324928:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789081781.050846:0:14755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081781.050873:0:14755:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c53f7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789081781.052544:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821324928 00000100:00100000:1.0:1789081781.052559:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821324928 00000100:00100000:3.0:1789081781.054612:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789081781.054629:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+16:14755:x1875987821324928:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789081781.055275:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+16:14755:x1875987821324928:12345-0@lo:502:mount.lustre.0 Request processed in 649us (4425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081781.055284:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789081781.055560:0:14755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14755:1875987821324928:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789081781.055886:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789081781.055945:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1789081781.055997:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1789081781.056046:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1789081781.056096:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1789081781.056159:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1789081781.056741:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1789081781.056777:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1789081781.056828:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789081781.056865:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1789081781.056897:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1789081781.056942:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1789081781.057540:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1789081781.058753:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1789081781.058862:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1789081781.058901:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1789081781.058930:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1789081781.058971:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1789081781.059005:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1789081781.059040:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1789081781.059124:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1789081781.059162:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1789081781.059209:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1789081781.059258:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1789081781.059294:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1789081781.059335:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1789081781.059380:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1789081781.059415:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1789081781.059449:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1789081781.059496:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1789081781.059544:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1789081781.059576:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1789081781.059605:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1789081781.059646:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1789081781.059678:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1789081781.059719:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1789081781.059766:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1789081781.059793:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1789081781.059842:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1789081781.059876:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1789081781.059927:0:14755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14755:1875987821325056:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789081781.060004:0:14755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081781.060053:0:14755:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c53f7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789081781.060302:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821325056 00000100:00100000:3.0:1789081781.060318:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821325056 00000100:00100000:3.0:1789081781.060373:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789081781.060382:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+16:14755:x1875987821325056:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789081781.060843:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+16:14755:x1875987821325056:12345-0@lo:502:mount.lustre.0 Request processed in 461us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081781.060852:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789081781.060910:0:14755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14755:1875987821325056:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789081781.061055:0:14755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1789081781.061067:0:14755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1789081781.064956:0:14778:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789081781.064987:0:14778:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9e10f9694d40) 00000020:00000080:1.0:1789081781.065010:0:14778:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1789081781.065201:0:14778:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e10f98e2800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789081781.065206:0:14778:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e10f98e2800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789081781.065208:0:14778:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e10f98e2800 3 00010000:00080000:1.0:1789081781.065243:0:14778:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e1101c75000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.117@tcp at head 00010000:00010000:1.0:1789081781.066919:0:14778:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1789081781.067041:0:14778:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789081781.067079:0:14778:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789081781.067107:0:14778:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xb7cb3d7479d608b5 00000100:00080000:1.0:1789081781.067118:0:14778:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789081781.067124:0:14778:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e1101c75000 using connection 192.168.201.117@tcp/0@lo 00000100:00100000:1.0:1789081781.067179:0:14778:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e10fada4a80 x1875987821325184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789081781.067220:0:14778:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789081781.067730:0:491:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789081781.067737:0:491:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789081781.067740:0:491:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789081781.067744:0:491:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789081781.067807:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789081781.067821:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875987821325312:0@lo:400:kworker.0 00000100:00100000:3.0:1789081781.067915:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081781.067990:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821325312 00000100:00100000:3.0:1789081781.068000:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821325312 00000100:00100000:3.0:1789081781.068057:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789081781.068067:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875987821325312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081781.068127:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875987821325312:12345-0@lo:400:kworker.0 Request processed in 61us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081781.068134:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789081781.068668:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e10f5c00e00 x1875987821325312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789081797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789081781.068682:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875987821325312:0@lo:400:kworker.0 00000100:00100000:0.0:1789081781.069110:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1875987821325184:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789081781.069153:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081781.069225:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821325184 00000100:00100000:0.0:1789081781.069231:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821325184 00000100:00100000:0.0:1789081781.069263:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789081781.069269:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3302:x1875987821325184:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789081781.069306:0:14122:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 447 last 0 00000020:00000080:0.0:1789081781.069349:0:14122:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xb7cb3d7479d608bc 00000004:00100000:0.0:1789081781.069365:0:14122:0:(mdt_handler.c:7406:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789081781.069398:0:14122:0:(import.c:65:import_set_state_nolock()) ffff9e10c6721800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789081781.069454:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875987821325184:12345-0@lo:38:llog_process_th.0 Request processed in 183us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081781.069461:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789081781.069491:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e10fada4a80 x1875987821325184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789081791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081781.069500:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789081781.069506:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1789081781.069513:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789081781.069518:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789081781.069521:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e1101c75000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789081781.069553:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1875987821325184:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1789081781.080564:0:14778:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1789081781.080635:0:14755:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1789081781.080673:0:14755:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789081781.080690:0:14755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101775800/0xb7cb3d7479d608a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d608a7 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081781.080702:0:14755:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e1101775800/0xb7cb3d7479d608a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d608a7 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789081781.080756:0:14755:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789081781.080758:0:14755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789081781.080760:0:14755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789081781.080761:0:14755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789081781.080762:0:14755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789081781.080764:0:14755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789081781.080765:0:14755:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789081781.080767:0:14755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789081781.080768:0:14755:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789081781.080772:0:14755:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1789081781.080775:0:14755:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789081781.080776:0:14755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789081781.080777:0:14755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789081781.080778:0:14755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789081781.080779:0:14755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789081781.080780:0:14755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789081781.080781:0:14755:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789081781.080783:0:14755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789081781.080784:0:14755:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789081781.080824:0:14755:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789081781.080845:0:14755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14755:1875987821325440:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789081781.080917:0:14755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081781.080953:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821325440 00000100:00100000:3.0:1789081781.080960:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821325440 00000100:00100000:3.0:1789081781.085324:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789081781.085339:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+16:14755:x1875987821325440:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789081781.085378:0:14116:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789081781.085408:0:14116:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1789081781.085807:0:14755:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d17d30c0 going to sleep for 11 seconds 20000000:01000000:3.0:1789081781.117287:0:14116:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789081781.117308:0:14116:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1789081781.119176:0:14137:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789081781.119187:0:14137:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789081781.119216:0:14137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e10d1bd1c00/0xb7cb3d7479d608c3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081781.119237:0:14137:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e1101983400/0xb7cb3d7479d60830 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d60829 expref: 16 pid: 14114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081781.119246:0:14137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e10d1bd1c00/0xb7cb3d7479d608c3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081781.119293:0:14137:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e1101983400/0xb7cb3d7479d60830 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb7cb3d7479d60829 expref: 16 pid: 14114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081781.119308:0:14137:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e1101983400/0xb7cb3d7479d60830 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb7cb3d7479d60829 expref: 16 pid: 14114 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081781.119325:0:14137:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada5880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14137:1875987821325568:0@lo:104: 00000100:00100000:1.0:1789081781.119392:0:14137:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081781.119462:0:14137:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c5215600 going to sleep for 11 seconds 00000100:00100000:3.0:1789081781.119682:0:14104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821325568 00000100:00100000:3.0:1789081781.119691:0:14104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821325568 00000100:00100000:3.0:1789081781.119745:0:14104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789081781.119755:0:14104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10fada7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+3:14137:x1875987821325568:12345-0@lo:104: 00010000:00010000:3.0:1789081781.119769:0:14104:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0400/0xb7cb3d7479d60829 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d60830 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081781.119828:0:14104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789081781.119834:0:14104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10fada7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+3:14137:x1875987821325568:12345-0@lo:104: Request processed in 81us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081781.119842:0:14104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789081781.120063:0:14137:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada5880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14137:1875987821325568:0@lo:104: 00010000:00010000:1.0:1789081781.120083:0:14137:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e10d1bd1c00/0xb7cb3d7479d608c3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081781.120300:0:14109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789081781.120307:0:14109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0400/0xb7cb3d7479d60829 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d60830 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081781.120314:0:14109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10d1bd0400 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:3.0:1789081781.120318:0:14109:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0400/0xb7cb3d7479d60829 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb7cb3d7479d60830 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081781.120327:0:14109:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0400/0xb7cb3d7479d60829 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb7cb3d7479d60830 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789081781.120334:0:14109:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0400/0xb7cb3d7479d60829 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb7cb3d7479d60830 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789081781.120341:0:14109:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789081781.120382:0:14109:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0400/0xb7cb3d7479d60829 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d60830 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081781.120389:0:14109:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789081781.120408:0:14109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0400/0xb7cb3d7479d60829 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d60830 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081781.120415:0:14109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0400/0xb7cb3d7479d60829 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d60830 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081781.120441:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081781.120444:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081781.120445:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081781.120459:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:3304:1875987821325696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789081781.120494:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081781.120684:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821325696 00000100:00100000:1.0:1789081781.120689:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821325696 00010000:00010000:1.0:1789081781.120710:0:14108:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e1101983400/0xb7cb3d7479d60830 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d60829 expref: 17 pid: 14114 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081781.120740:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789081781.120747:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+17:3304:x1875987821325696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789081781.120759:0:14108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789081781.120763:0:14108:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e1101983400/0xb7cb3d7479d60830 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d60829 expref: 17 pid: 14114 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081781.120773:0:14108:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e1101983400/0xb7cb3d7479d60830 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb7cb3d7479d60829 expref: 17 pid: 14114 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081781.120789:0:14108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e1101983400/0xb7cb3d7479d60830 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb7cb3d7479d60829 expref: 17 pid: 14114 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081781.120802:0:14108:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e10d1bd1c00/0xb7cb3d7479d608c3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081781.120811:0:14108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10d1bd1c00/0xb7cb3d7479d608c3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789081781.120830:0:14108:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001643568s 00010000:00010000:1.0:1789081781.120835:0:14108:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e10d1bd1c00/0xb7cb3d7479d608c3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081781.120841:0:14108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e10d1bd1c00/0xb7cb3d7479d608c3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081781.120859:0:14108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e10d1bd1c00/0xb7cb3d7479d608c3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081781.120865:0:14108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e10d1bd1c00/0xb7cb3d7479d608c3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081781.120870:0:14108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10d1bd1c00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:1.0:1789081781.120873:0:14108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e10d1bd1c00/0xb7cb3d7479d608c3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081781.120880:0:14108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e10d1bd1c00/0xb7cb3d7479d608c3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081781.120893:0:14108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e10d1bd1c00/0xb7cb3d7479d608c3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081781.120902:0:14108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789081781.120936:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+16:3304:x1875987821325696:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081781.120943:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789081781.121048:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:3304:1875987821325696:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789081781.121071:0:14137:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e10d1bd1c00/0xb7cb3d7479d608c3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081781.121079:0:14137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e10d1bd1c00/0xb7cb3d7479d608c3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081781.121086:0:14137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10d1bd1c00/0xb7cb3d7479d608c3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081781.127630:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+15:14755:x1875987821325440:12345-0@lo:253:mount.lustre.0 Request processed in 42285us (46702us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081781.127646:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789081781.127764:0:14755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14755:1875987821325440:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789081781.127781:0:14755:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789081781.127784:0:14755:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789081781.127786:0:14755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789081781.127787:0:14755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789081781.127788:0:14755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789081781.127789:0:14755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789081781.127791:0:14755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789081781.127792:0:14755:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789081781.127794:0:14755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789081781.127796:0:14755:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789081781.127812:0:14755:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789081781.133706:0:14755:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789081781.133866:0:14755:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789081781.134099:0:14755:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789081781.134319:0:14755:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789081781.135344:0:14755:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789081781.135817:0:14755:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789081781.136916:0:14755:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1789081781.151508:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1789081781.197705:0:14755:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789081781.197713:0:14755:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789081781.197749:0:14755:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789081781.197815:0:14755:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.117@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789081781.197830:0:14755:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789081781.197859:0:14755:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00000040:00080000:1.0:1789081781.601003:0:14155:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789081782.187061:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789081782.624753:0:14118:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789081782.624761:0:14118:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e10ff613800 from 7 10000000:01000000:3.0:1789081782.624766:0:14118:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789081782.624811:0:14118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101999c00/0xb7cb3d7479d608ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081782.624832:0:14118:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e1101999c00/0xb7cb3d7479d608ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081782.624844:0:14118:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e1101999c00/0xb7cb3d7479d608ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081782.624872:0:14118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c00e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14118:1875987821325824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789081782.624973:0:14118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081782.625021:0:14118:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c91673c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789081782.625250:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821325824 00000100:00100000:0.0:1789081782.625258:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821325824 00000100:00100000:0.0:1789081782.625322:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789081782.625341:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+15:14118:x1875987821325824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789081782.625358:0:14114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081782.625375:0:14114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e1101983800/0xb7cb3d7479d608d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d608ca expref: -99 pid: 14114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081782.625401:0:14114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e1101983800/0xb7cb3d7479d608d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d608ca expref: 16 pid: 14114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081782.625413:0:14114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e1101983800/0xb7cb3d7479d608d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d608ca expref: 16 pid: 14114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081782.625422:0:14114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101983800, rc 0) 00000100:00100000:0.0:1789081782.625466:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+16:14118:x1875987821325824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081782.625474:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789081782.625521:0:14118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c00e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14118:1875987821325824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789081782.625559:0:14118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e1101999c00/0xb7cb3d7479d608ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d608d1 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081782.625570:0:14118:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e1101999c00/0xb7cb3d7479d608ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d608d1 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081782.625627:0:14118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b25500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14118:1875987821325952:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789081782.625659:0:14118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081782.625673:0:14118:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c50670c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789081782.625686:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821325952 00000100:00100000:0.0:1789081782.625690:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821325952 00000100:00100000:0.0:1789081782.625711:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789081782.625723:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+16:14118:x1875987821325952:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789081782.625738:0:14116:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789081782.625756:0:14116:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789081782.625759:0:14116:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1789081782.625829:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+16:14118:x1875987821325952:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 106us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081782.625836:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789081782.625865:0:14118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b25500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14118:1875987821325952:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789081782.625920:0:14118:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789081782.625926:0:14118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101999c00/0xb7cb3d7479d608ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d608d1 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081782.625935:0:14118:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e1101999c00/0xb7cb3d7479d608ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d608d1 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081783.196642:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081784.222478:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081785.244665:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789081786.205730:0:491:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789081786.205739:0:491:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789081786.205743:0:491:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789081786.205746:0:491:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789081786.205809:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:3305:1875987821326080:0@lo:400:kworker.0 00000100:00100000:2.0:1789081786.205809:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875987821326208:0@lo:400:kworker.0 00000100:00100000:2.0:1789081786.205896:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081786.205968:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821326208 00000100:00100000:2.0:1789081786.205975:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821326208 00000100:00100000:2.0:1789081786.206013:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789081786.206022:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875987821326208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789081786.206069:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875987821326208:12345-0@lo:400:kworker.0 Request processed in 48us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081786.206089:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789081786.206129:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e10f5c01500 x1875987821326208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789081802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789081786.206143:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875987821326208:0@lo:400:kworker.0 00000100:00100000:2.0:1789081786.208351:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875987821326336:0@lo:400:kworker.0 00000100:00100000:2.0:1789081786.208435:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081786.208794:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081786.208843:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821326336 00000100:00100000:3.0:1789081786.208851:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821326336 00000100:00080000:0.0:1789081786.208895:0:14117:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789081786.208905:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789081786.208913:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875987821326336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081786.208979:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875987821326336:12345-0@lo:400:kworker.0 Request processed in 66us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081786.208986:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789081786.209016:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821326080 00000100:00100000:3.0:1789081786.209020:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821326080 00000100:00100000:3.0:1789081786.209044:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789081786.209050:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+16:3305:x1875987821326080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081786.209096:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+16:3305:x1875987821326080:12345-0@lo:400:kworker.0 Request processed in 46us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081786.209102:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789081786.209296:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:3305:1875987821326080:0@lo:400:kworker.0 00010000:00080000:0.0:1789081786.209297:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e10f5c03480 x1875987821326336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789081802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081786.209310:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875987821326336:0@lo:400:kworker.0 00010000:00010000:3.0:1789081786.268841:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081787.293048:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789081788.110740:0:15120:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg117-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789081788.321581:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081789.341751:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081790.365928:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789081791.337180:0:491:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789081791.337187:0:491:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789081791.337190:0:491:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789081791.337193:0:491:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789081791.337581:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:3304:1875987821326464:0@lo:400:kworker.0 00000100:00100000:0.0:1789081791.338433:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875987821326720:0@lo:400:kworker.0 00000100:00100000:0.0:1789081791.338513:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081791.338596:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789081791.338812:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081791.339484:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821326464 00000100:00100000:3.0:1789081791.339494:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821326464 00000100:00100000:3.0:1789081791.339569:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789081791.339578:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+16:3304:x1875987821326464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081791.340016:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875987821326592:0@lo:400:kworker.0 00000100:00100000:0.0:1789081791.340061:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081791.340101:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821326720 00000100:00100000:0.0:1789081791.340105:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821326720 00000100:00100000:0.0:1789081791.340144:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821326592 00000100:00100000:0.0:1789081791.340147:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821326592 00000100:00100000:0.0:1789081791.340160:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789081791.340165:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875987821326720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081791.340367:0:14123:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789081791.340377:0:14123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1789081791.340477:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789081791.340485:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875987821326592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081791.340518:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875987821326592:12345-0@lo:400:kworker.0 Request processed in 35us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081791.340546:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789081791.340769:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+16:3304:x1875987821326464:12345-0@lo:400:kworker.0 Request processed in 1191us (1956us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081791.340777:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789081791.340834:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:3304:1875987821326464:0@lo:400:kworker.0 00000100:00100000:0.0:1789081791.341508:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875987821326720:12345-0@lo:400:kworker.0 Request processed in 41us (1693us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081791.341519:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789081791.341560:0:14117:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789081791.342277:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e10f9b27480 x1875987821326592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789081807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081791.342358:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875987821326592:0@lo:400:kworker.0 00010000:00080000:0.0:1789081791.342380:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e10f9b26300 x1875987821326720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789081807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081791.342389:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875987821326720:0@lo:400:kworker.0 00010000:00010000:2.0:1789081791.390890:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789081791.837998:0:14155:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789081792.418916:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081793.437868:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789081794.337112:0:3302:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789081779/real 1789081779] req@ffff9e10d2dc0700 x1875987821322496/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789081794 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789081794.337148:0:3302:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e10d2dc0700 x1875987821322496/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789081794 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789081794.337159:0:3302:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789081779/real 1789081779] req@ffff9e10d2dc2a00 x1875987821322752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789081794 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789081794.337190:0:3302:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e10d2dc2a00 x1875987821322752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789081794 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789081794.337211:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e10ff77b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789081794.337276:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789081794.337281:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875987821322496:0@lo:8:kworker.0 00000100:00080000:2.0:1789081794.337287:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e10f97e8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789081794.341561:0:491:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:1.0:1789081794.341705:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789081794.341728:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:3304:1875987821326848:0@lo:400:kworker.0 00000100:00100000:1.0:1789081794.341823:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081794.341892:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821326848 00000100:00100000:1.0:1789081794.341900:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821326848 00000100:00100000:1.0:1789081794.341954:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789081794.341963:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+16:3304:x1875987821326848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081794.342015:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+16:3304:x1875987821326848:12345-0@lo:400:kworker.0 Request processed in 53us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081794.342024:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789081794.342074:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:3304:1875987821326848:0@lo:400:kworker.0 00000100:00080000:3.0:1789081794.342249:0:491:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789081794.342255:0:491:0:(import.c:65:import_set_state_nolock()) ffff9e10f97e8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789081794.342260:0:491:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 446 00000100:00080000:3.0:1789081794.342265:0:491:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789081794.342270:0:491:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e10f97e8800 using connection 192.168.201.117@tcp/0@lo 00000100:00100000:3.0:1789081794.342312:0:491:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e10f5c00000 x1875987821326976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789081794.342326:0:491:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789081794.342329:0:491:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789081794.342331:0:491:0:(import.c:65:import_set_state_nolock()) ffff9e10ff77b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789081794.342334:0:491:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 446 00000100:00080000:3.0:1789081794.342336:0:491:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789081794.342340:0:491:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e10ff77b000 using connection 192.168.201.117@tcp/0@lo 00000100:00100000:3.0:1789081794.342350:0:491:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e10f5c02d80 x1875987821327104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789081794.342422:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875987821327360:0@lo:400:kworker.0 00000100:00100000:0.0:1789081794.342515:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789081794.342549:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875987821327232:0@lo:400:kworker.0 00000100:00100000:0.0:1789081794.342595:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081794.342717:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821327232 00000100:00100000:1.0:1789081794.342723:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821327232 00000100:00100000:1.0:1789081794.342776:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789081794.342783:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875987821327232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081794.342829:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875987821327232:12345-0@lo:400:kworker.0 Request processed in 47us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081794.342836:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789081794.342870:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e10f5c03100 x1875987821327232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789081810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789081794.342882:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875987821327232:0@lo:400:kworker.0 00000100:00100000:3.0:1789081794.343092:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081794.343159:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821327360 00000100:00100000:0.0:1789081794.343164:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821327360 00000100:00100000:0.0:1789081794.343217:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789081794.343232:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875987821327360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081794.343267:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875987821327360:12345-0@lo:400:kworker.0 Request processed in 37us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081794.343274:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1789081794.344383:0:14117:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789081794.344513:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e10f5c01880 x1875987821327360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789081810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789081794.344560:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875987821327360:0@lo:400:kworker.0 00000100:00080000:2.0:1789081794.345265:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789081794.345273:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875987821322752:0@lo:8:kworker.0 00000100:00100000:2.0:1789081794.345307:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875987821326976:0@lo:8:kworker.0 00000100:00100000:2.0:1789081794.345369:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081794.345414:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875987821327104:0@lo:8:kworker.0 00000100:00100000:2.0:1789081794.345448:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081794.345561:0:14758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821326976 00000100:00100000:0.0:1789081794.345568:0:14758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821326976 00000100:00100000:0.0:1789081794.345608:0:14758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821327104 00000100:00100000:0.0:1789081794.345612:0:14758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821327104 00000100:00100000:0.0:1789081794.345627:0:14758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789081794.345634:0:14758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3302:x1875987821326976:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789081794.345666:0:14758:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 461 last 0 00000020:00000080:0.0:1789081794.345700:0:14758:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb7cb3d7479d608d8 00002000:00100000:0.0:1789081794.345713:0:14758:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9e10f582d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113719 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789081794.345717:0:14758:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1789081794.345720:0:14758:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789081794.346079:0:14758:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789081794.346105:0:14758:0:(import.c:65:import_set_state_nolock()) ffff9e10f5828800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789081794.346166:0:14758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1875987821326976:12345-0@lo:8:kworker.0 Request processed in 531us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081794.346173:0:14758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789081794.346191:0:14758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789081794.346196:0:14758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3302:x1875987821327104:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789081794.346207:0:14758:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789081794.346233:0:14758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3302:x1875987821327104:12345-0@lo:8:kworker.0 Request processed in 36us (784us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789081794.346239:0:14758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789081794.346288:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e10f5c00000 x1875987821326976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789081814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081794.346300:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789081794.346308:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789081794.346315:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789081794.346320:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789081794.346323:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e10f97e8800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789081794.346334:0:3302:0:(osp_dev.c:1791:osp_import_event()) got connected 00000100:00100000:0.0:1789081794.346339:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875987821326976:0@lo:8:kworker.0 00000100:00080000:0.0:1789081794.346349:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e10ff77b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789081794.346353:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789081794.346356:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875987821327104:0@lo:8:kworker.0 00000004:00080000:1.0:1789081794.346759:0:14144:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:1.0:1789081794.346783:0:14144:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14144:1875987821327616:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789081794.346823:0:14144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081794.346842:0:14144:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c60c2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789081794.346855:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821327488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789081794.346878:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081794.346912:0:14758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821327616 00000100:00100000:1.0:1789081794.346918:0:14758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821327616 00000100:00100000:1.0:1789081794.346981:0:14758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789081794.346988:0:14758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10fada6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14144:x1875987821327616:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1789081794.349475:0:14758:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1789081794.349487:0:14758:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1789081794.349493:0:14758:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000004:00080000:2.0:1789081794.353175:0:14143:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789081794.353513:0:14143:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 461235987888ns, next at 0ns, rc = 0 00000100:00100000:2.0:1789081794.353589:0:14760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821327488 00000100:00100000:2.0:1789081794.353598:0:14760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821327488 00000100:00100000:2.0:1789081794.353645:0:14760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789081794.353655:0:14760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10fada4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875987821327488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789081794.353687:0:14760:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789081794.353778:0:14760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10fada4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875987821327488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (6897us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081794.353785:0:14760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1789081794.354200:0:14117:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789081794.354254:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e10fada5880 x1875987821327488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081810 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789081794.354275:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821327488:0@lo:13:osp-pre-0-0.0 00002000:00010000:1.0:1789081794.386511:0:14758:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789081794.386574:0:14758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040ced8b5/0xb7cb3d7479d608df lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.386594:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1789081794.386605:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789081794.386614:0:14758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040ced8b5/0xb7cb3d7479d608df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.386634:0:14758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040ced8b5/0xb7cb3d7479d608df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.386645:0:14758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040ced8b5/0xb7cb3d7479d608df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.386654:0:14758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040ced8b5/0xb7cb3d7479d608df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.386692:0:14758:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789081794.386704:0:14109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789081794.386709:0:14109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040ced8b5/0xb7cb3d7479d608df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.386717:0:14109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10d1bd1600 already unused, calling callback (ffffffffc1784220) 00010000:00010000:1.0:1789081794.386722:0:14109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040ced8b5/0xb7cb3d7479d608df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.386732:0:14109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040ced8b5/0xb7cb3d7479d608df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.386747:0:14109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040ced8b5/0xb7cb3d7479d608df lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.386765:0:14109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040ced8b5/0xb7cb3d7479d608df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.386783:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081794.386785:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081794.386786:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789081794.387288:0:14758:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789081794.387296:0:14758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c92cf13/0xb7cb3d7479d608e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.387305:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1789081794.387308:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789081794.387312:0:14758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c92cf13/0xb7cb3d7479d608e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.387322:0:14758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c92cf13/0xb7cb3d7479d608e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.387329:0:14758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c92cf13/0xb7cb3d7479d608e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.387335:0:14758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c92cf13/0xb7cb3d7479d608e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.387359:0:14758:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789081794.387366:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789081794.387376:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c92cf13/0xb7cb3d7479d608e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.387383:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10d1bd1800 already unused, calling callback (ffffffffc1784220) 00010000:00010000:1.0:1789081794.387385:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c92cf13/0xb7cb3d7479d608e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.387392:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c92cf13/0xb7cb3d7479d608e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.387402:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c92cf13/0xb7cb3d7479d608e6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.387409:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c92cf13/0xb7cb3d7479d608e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.387420:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081794.387421:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081794.387423:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789081794.387821:0:14758:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789081794.387827:0:14758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000414adac/0xb7cb3d7479d608ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.387836:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1789081794.387839:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789081794.387843:0:14758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000414adac/0xb7cb3d7479d608ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.387863:0:14758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000414adac/0xb7cb3d7479d608ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.387871:0:14758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000414adac/0xb7cb3d7479d608ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.387879:0:14758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000414adac/0xb7cb3d7479d608ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.387893:0:14758:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789081794.387901:0:14109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789081794.387904:0:14109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000414adac/0xb7cb3d7479d608ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.387911:0:14109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10d1bd1200 already unused, calling callback (ffffffffc1784220) 00010000:00010000:1.0:1789081794.387914:0:14109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000414adac/0xb7cb3d7479d608ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.387921:0:14109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000414adac/0xb7cb3d7479d608ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.387945:0:14109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000414adac/0xb7cb3d7479d608ed lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.387953:0:14109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000414adac/0xb7cb3d7479d608ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.387971:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081794.387972:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081794.387974:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789081794.388357:0:14758:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789081794.388362:0:14758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4b69791/0xb7cb3d7479d608f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.388370:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1789081794.388374:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789081794.388377:0:14758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4b69791/0xb7cb3d7479d608f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.388386:0:14758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4b69791/0xb7cb3d7479d608f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.388393:0:14758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4b69791/0xb7cb3d7479d608f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.388400:0:14758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4b69791/0xb7cb3d7479d608f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.388413:0:14758:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789081794.388422:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789081794.388426:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4b69791/0xb7cb3d7479d608f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.388444:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10d1bd0600 already unused, calling callback (ffffffffc1784220) 00010000:00010000:1.0:1789081794.388448:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4b69791/0xb7cb3d7479d608f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.388455:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4b69791/0xb7cb3d7479d608f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.388466:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4b69791/0xb7cb3d7479d608f4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.388474:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4b69791/0xb7cb3d7479d608f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.388487:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081794.388490:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081794.388491:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789081794.388874:0:14758:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789081794.388880:0:14758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb1d8b54/0xb7cb3d7479d608fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.388888:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1789081794.388891:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789081794.388895:0:14758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb1d8b54/0xb7cb3d7479d608fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.388904:0:14758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb1d8b54/0xb7cb3d7479d608fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.388917:0:14758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb1d8b54/0xb7cb3d7479d608fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.388924:0:14758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb1d8b54/0xb7cb3d7479d608fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.389198:0:14758:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789081794.389210:0:14109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789081794.389214:0:14109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb1d8b54/0xb7cb3d7479d608fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.389222:0:14109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10d1bd1c00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:1.0:1789081794.389225:0:14109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb1d8b54/0xb7cb3d7479d608fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.389233:0:14109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb1d8b54/0xb7cb3d7479d608fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.389245:0:14109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb1d8b54/0xb7cb3d7479d608fb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.389253:0:14109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb1d8b54/0xb7cb3d7479d608fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.389268:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081794.389273:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081794.389275:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789081794.389684:0:14758:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789081794.389691:0:14758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8e5c9c7/0xb7cb3d7479d60902 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.389699:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1789081794.389702:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789081794.389707:0:14758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8e5c9c7/0xb7cb3d7479d60902 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.389716:0:14758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8e5c9c7/0xb7cb3d7479d60902 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.389724:0:14758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8e5c9c7/0xb7cb3d7479d60902 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.389731:0:14758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8e5c9c7/0xb7cb3d7479d60902 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.389747:0:14758:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789081794.389754:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789081794.389758:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8e5c9c7/0xb7cb3d7479d60902 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.389765:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10d1bd0400 already unused, calling callback (ffffffffc1784220) 00010000:00010000:1.0:1789081794.389768:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8e5c9c7/0xb7cb3d7479d60902 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.389787:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8e5c9c7/0xb7cb3d7479d60902 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.389799:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8e5c9c7/0xb7cb3d7479d60902 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.389805:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8e5c9c7/0xb7cb3d7479d60902 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.389819:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081794.389820:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081794.389822:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789081794.390230:0:14758:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789081794.390237:0:14758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066f81bdc/0xb7cb3d7479d60909 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.390245:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1789081794.390249:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789081794.390254:0:14758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066f81bdc/0xb7cb3d7479d60909 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.390263:0:14758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066f81bdc/0xb7cb3d7479d60909 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.390271:0:14758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066f81bdc/0xb7cb3d7479d60909 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.390284:0:14758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066f81bdc/0xb7cb3d7479d60909 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.390297:0:14758:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789081794.390304:0:14109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789081794.390308:0:14109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066f81bdc/0xb7cb3d7479d60909 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.390314:0:14109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10d1bd0a00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:1.0:1789081794.390317:0:14109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066f81bdc/0xb7cb3d7479d60909 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.390324:0:14109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066f81bdc/0xb7cb3d7479d60909 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.390333:0:14109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066f81bdc/0xb7cb3d7479d60909 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.390340:0:14109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066f81bdc/0xb7cb3d7479d60909 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.390353:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081794.390354:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081794.390356:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789081794.393304:0:14758:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789081794.393331:0:14758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f45fb063/0xb7cb3d7479d60910 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.393351:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1789081794.393356:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789081794.393363:0:14758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f45fb063/0xb7cb3d7479d60910 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.393378:0:14758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f45fb063/0xb7cb3d7479d60910 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.393388:0:14758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f45fb063/0xb7cb3d7479d60910 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.393396:0:14758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f45fb063/0xb7cb3d7479d60910 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.393649:0:14758:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789081794.393850:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789081794.393859:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f45fb063/0xb7cb3d7479d60910 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.393868:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10d1bd1e00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:3.0:1789081794.393880:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f45fb063/0xb7cb3d7479d60910 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.393889:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f45fb063/0xb7cb3d7479d60910 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.393909:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f45fb063/0xb7cb3d7479d60910 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.393917:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f45fb063/0xb7cb3d7479d60910 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.393949:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081794.393952:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081794.393954:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789081794.394565:0:14758:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789081794.396764:0:14758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051a06635/0xb7cb3d7479d60917 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.396784:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1789081794.396789:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789081794.396797:0:14758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051a06635/0xb7cb3d7479d60917 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.396814:0:14758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051a06635/0xb7cb3d7479d60917 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.396836:0:14758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051a06635/0xb7cb3d7479d60917 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.396844:0:14758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051a06635/0xb7cb3d7479d60917 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.396865:0:14758:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789081794.396881:0:14109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789081794.396887:0:14109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051a06635/0xb7cb3d7479d60917 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.396895:0:14109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10d1bd0800 already unused, calling callback (ffffffffc1784220) 00010000:00010000:1.0:1789081794.396900:0:14109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051a06635/0xb7cb3d7479d60917 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.396911:0:14109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051a06635/0xb7cb3d7479d60917 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.396941:0:14109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051a06635/0xb7cb3d7479d60917 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.396949:0:14109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051a06635/0xb7cb3d7479d60917 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.396972:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081794.396979:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081794.396980:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789081794.397577:0:14758:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789081794.397584:0:14758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000105e58c5/0xb7cb3d7479d6091e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.397593:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1789081794.397596:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789081794.397601:0:14758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000105e58c5/0xb7cb3d7479d6091e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.397611:0:14758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000105e58c5/0xb7cb3d7479d6091e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.397619:0:14758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000105e58c5/0xb7cb3d7479d6091e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.397625:0:14758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000105e58c5/0xb7cb3d7479d6091e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.397643:0:14758:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789081794.397653:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789081794.397657:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000105e58c5/0xb7cb3d7479d6091e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.397664:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13ae800 already unused, calling callback (ffffffffc1784220) 00010000:00010000:1.0:1789081794.397668:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000105e58c5/0xb7cb3d7479d6091e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.399488:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000105e58c5/0xb7cb3d7479d6091e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.399510:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000105e58c5/0xb7cb3d7479d6091e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.399518:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000105e58c5/0xb7cb3d7479d6091e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.399555:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081794.399557:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081794.399559:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789081794.400239:0:14758:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789081794.400248:0:14758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6fc7938/0xb7cb3d7479d60925 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.400261:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1789081794.400266:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789081794.400272:0:14758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6fc7938/0xb7cb3d7479d60925 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.400285:0:14758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6fc7938/0xb7cb3d7479d60925 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.400293:0:14758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6fc7938/0xb7cb3d7479d60925 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.400307:0:14758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6fc7938/0xb7cb3d7479d60925 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.400325:0:14758:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789081794.400336:0:14109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789081794.400341:0:14109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6fc7938/0xb7cb3d7479d60925 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.400349:0:14109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13af800 already unused, calling callback (ffffffffc1784220) 00010000:00010000:1.0:1789081794.400353:0:14109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6fc7938/0xb7cb3d7479d60925 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.400361:0:14109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6fc7938/0xb7cb3d7479d60925 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.400374:0:14109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6fc7938/0xb7cb3d7479d60925 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.400380:0:14109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6fc7938/0xb7cb3d7479d60925 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.400393:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081794.400395:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081794.400396:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789081794.400870:0:14758:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789081794.400885:0:14758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7dbe97b/0xb7cb3d7479d6092c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.400895:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1789081794.400898:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789081794.400903:0:14758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7dbe97b/0xb7cb3d7479d6092c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.400913:0:14758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7dbe97b/0xb7cb3d7479d6092c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.400921:0:14758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7dbe97b/0xb7cb3d7479d6092c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.401336:0:14758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7dbe97b/0xb7cb3d7479d6092c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.401358:0:14758:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789081794.401401:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789081794.401408:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7dbe97b/0xb7cb3d7479d6092c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.401416:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13af000 already unused, calling callback (ffffffffc1784220) 00010000:00010000:3.0:1789081794.401420:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7dbe97b/0xb7cb3d7479d6092c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.401441:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7dbe97b/0xb7cb3d7479d6092c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.401456:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7dbe97b/0xb7cb3d7479d6092c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.401477:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7dbe97b/0xb7cb3d7479d6092c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.401493:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081794.401495:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081794.401497:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789081794.405986:0:14758:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789081794.405999:0:14758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009dc56b41/0xb7cb3d7479d60933 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.406014:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1789081794.406019:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081794.406026:0:14758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009dc56b41/0xb7cb3d7479d60933 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.406039:0:14758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009dc56b41/0xb7cb3d7479d60933 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.406052:0:14758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009dc56b41/0xb7cb3d7479d60933 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.406061:0:14758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009dc56b41/0xb7cb3d7479d60933 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.406088:0:14758:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789081794.406663:0:14758:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789081794.406676:0:14758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d6093a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.406685:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1789081794.406688:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081794.406692:0:14758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d6093a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.406702:0:14758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d6093a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.406710:0:14758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d6093a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.406718:0:14758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d6093a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.406735:0:14758:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789081794.406748:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789081794.406753:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009dc56b41/0xb7cb3d7479d60933 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.406760:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998800 already unused, calling callback (ffffffffc1784220) 00010000:00010000:3.0:1789081794.406765:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009dc56b41/0xb7cb3d7479d60933 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.406833:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009dc56b41/0xb7cb3d7479d60933 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.406859:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009dc56b41/0xb7cb3d7479d60933 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.406867:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009dc56b41/0xb7cb3d7479d60933 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.406884:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789081794.406887:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d6093a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.406894:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999600 already unused, calling callback (ffffffffc1784220) 00010000:00010000:3.0:1789081794.406897:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d6093a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.406904:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d6093a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.406914:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d6093a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.406921:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d6093a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.406944:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081794.406946:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081794.406953:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789081794.407385:0:14758:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789081794.407392:0:14758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fac1aed6/0xb7cb3d7479d60941 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.407401:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1789081794.407404:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081794.407409:0:14758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fac1aed6/0xb7cb3d7479d60941 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.407418:0:14758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fac1aed6/0xb7cb3d7479d60941 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.407426:0:14758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fac1aed6/0xb7cb3d7479d60941 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.407433:0:14758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fac1aed6/0xb7cb3d7479d60941 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.407450:0:14758:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789081794.407458:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789081794.407462:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fac1aed6/0xb7cb3d7479d60941 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.407468:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998e00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:3.0:1789081794.407471:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fac1aed6/0xb7cb3d7479d60941 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.407490:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fac1aed6/0xb7cb3d7479d60941 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.407501:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fac1aed6/0xb7cb3d7479d60941 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.407508:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fac1aed6/0xb7cb3d7479d60941 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.407545:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081794.407547:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081794.407549:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081794.408550:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789081794.408875:0:14758:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789081794.408885:0:14758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000819e4087/0xb7cb3d7479d60948 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.408898:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1789081794.408902:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081794.408909:0:14758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000819e4087/0xb7cb3d7479d60948 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.408921:0:14758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000819e4087/0xb7cb3d7479d60948 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.408940:0:14758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000819e4087/0xb7cb3d7479d60948 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.408962:0:14758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000819e4087/0xb7cb3d7479d60948 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.408985:0:14758:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789081794.409492:0:14758:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789081794.409499:0:14758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009944c9fc/0xb7cb3d7479d6094f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.409507:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1789081794.409510:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081794.409513:0:14758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009944c9fc/0xb7cb3d7479d6094f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.409557:0:14758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009944c9fc/0xb7cb3d7479d6094f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.409567:0:14758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009944c9fc/0xb7cb3d7479d6094f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.409574:0:14758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009944c9fc/0xb7cb3d7479d6094f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.409594:0:14758:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789081794.410001:0:14758:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789081794.410006:0:14758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001cb618a/0xb7cb3d7479d60956 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.410020:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1789081794.410023:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081794.410027:0:14758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001cb618a/0xb7cb3d7479d60956 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.410035:0:14758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001cb618a/0xb7cb3d7479d60956 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.410043:0:14758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001cb618a/0xb7cb3d7479d60956 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.410050:0:14758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001cb618a/0xb7cb3d7479d60956 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.410057:0:14758:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1789081794.410449:0:14758:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789081794.410455:0:14758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d6095d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.410463:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1789081794.410466:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081794.410470:0:14758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d6095d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.410479:0:14758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d6095d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.410498:0:14758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d6095d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.410506:0:14758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d6095d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.410513:0:14758:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1789081794.410871:0:14758:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789081794.410877:0:14758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae3bce25/0xb7cb3d7479d60964 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.410885:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1789081794.410888:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081794.410892:0:14758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae3bce25/0xb7cb3d7479d60964 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.410901:0:14758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae3bce25/0xb7cb3d7479d60964 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.410909:0:14758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae3bce25/0xb7cb3d7479d60964 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.410916:0:14758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae3bce25/0xb7cb3d7479d60964 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.410947:0:14758:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1789081794.411839:0:14758:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789081794.411846:0:14758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e192ea07/0xb7cb3d7479d6096b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.411857:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1789081794.411860:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081794.411865:0:14758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e192ea07/0xb7cb3d7479d6096b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.411875:0:14758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e192ea07/0xb7cb3d7479d6096b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.411883:0:14758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e192ea07/0xb7cb3d7479d6096b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.411891:0:14758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e192ea07/0xb7cb3d7479d6096b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.411899:0:14758:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:0.0:1789081794.412163:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1789081794.412171:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000819e4087/0xb7cb3d7479d60948 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081794.412180:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998000 already unused, calling callback (ffffffffc1784220) 00010000:00010000:0.0:1789081794.412184:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000819e4087/0xb7cb3d7479d60948 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081794.412194:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000819e4087/0xb7cb3d7479d60948 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081794.412213:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000819e4087/0xb7cb3d7479d60948 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081794.412231:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000819e4087/0xb7cb3d7479d60948 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081794.412251:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789081794.412255:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009944c9fc/0xb7cb3d7479d6094f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081794.412262:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999e00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:0.0:1789081794.412265:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009944c9fc/0xb7cb3d7479d6094f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081794.412272:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009944c9fc/0xb7cb3d7479d6094f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081794.412281:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009944c9fc/0xb7cb3d7479d6094f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081794.412288:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009944c9fc/0xb7cb3d7479d6094f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081794.412298:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789081794.412301:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001cb618a/0xb7cb3d7479d60956 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081794.412308:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999000 already unused, calling callback (ffffffffc1784220) 00010000:00010000:0.0:1789081794.412314:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001cb618a/0xb7cb3d7479d60956 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081794.412322:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001cb618a/0xb7cb3d7479d60956 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081794.412332:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001cb618a/0xb7cb3d7479d60956 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081794.412339:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001cb618a/0xb7cb3d7479d60956 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081794.412350:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789081794.412354:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d6095d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081794.412360:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998200 already unused, calling callback (ffffffffc1784220) 00010000:00010000:0.0:1789081794.412363:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d6095d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081794.412370:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d6095d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081794.412379:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d6095d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081794.412385:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d6095d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081794.412400:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789081794.412403:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae3bce25/0xb7cb3d7479d60964 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081794.412410:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999800 already unused, calling callback (ffffffffc1784220) 00010000:00010000:0.0:1789081794.412413:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae3bce25/0xb7cb3d7479d60964 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081794.412420:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae3bce25/0xb7cb3d7479d60964 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081794.412428:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae3bce25/0xb7cb3d7479d60964 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081794.412435:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae3bce25/0xb7cb3d7479d60964 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081794.412446:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789081794.412449:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e192ea07/0xb7cb3d7479d6096b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081794.412455:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999a00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:0.0:1789081794.412458:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e192ea07/0xb7cb3d7479d6096b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081794.412475:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e192ea07/0xb7cb3d7479d6096b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081794.412485:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e192ea07/0xb7cb3d7479d6096b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081794.412492:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e192ea07/0xb7cb3d7479d6096b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081794.412504:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081794.412506:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081794.412508:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081794.412602:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789081794.414308:0:14758:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789081794.414319:0:14758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a08dbed5/0xb7cb3d7479d60972 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.414333:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1789081794.414344:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081794.414351:0:14758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a08dbed5/0xb7cb3d7479d60972 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.414366:0:14758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a08dbed5/0xb7cb3d7479d60972 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.414375:0:14758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a08dbed5/0xb7cb3d7479d60972 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.414383:0:14758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a08dbed5/0xb7cb3d7479d60972 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.417070:0:14758:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789081794.417662:0:14758:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789081794.417672:0:14758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000268c54a7/0xb7cb3d7479d60979 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.417687:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1789081794.417692:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081794.417698:0:14758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000268c54a7/0xb7cb3d7479d60979 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.417711:0:14758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000268c54a7/0xb7cb3d7479d60979 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.417720:0:14758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000268c54a7/0xb7cb3d7479d60979 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.419321:0:14758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000268c54a7/0xb7cb3d7479d60979 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081794.420405:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789081794.420417:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a08dbed5/0xb7cb3d7479d60972 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081794.420428:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998c00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:0.0:1789081794.420434:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a08dbed5/0xb7cb3d7479d60972 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081794.420444:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a08dbed5/0xb7cb3d7479d60972 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081794.420465:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a08dbed5/0xb7cb3d7479d60972 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081794.420489:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a08dbed5/0xb7cb3d7479d60972 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081794.421433:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789081794.421444:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000268c54a7/0xb7cb3d7479d60979 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081794.421455:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998600 already unused, calling callback (ffffffffc1784220) 00010000:00010000:0.0:1789081794.421459:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000268c54a7/0xb7cb3d7479d60979 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081794.421469:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000268c54a7/0xb7cb3d7479d60979 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081794.421483:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000268c54a7/0xb7cb3d7479d60979 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081794.421491:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081794.421493:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081794.421497:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081794.422223:0:14758:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789081794.422233:0:14758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000268c54a7/0xb7cb3d7479d60979 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789081794.423187:0:14758:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789081794.423195:0:14758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7aa690f/0xb7cb3d7479d60980 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.423208:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1789081794.423213:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081794.423219:0:14758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7aa690f/0xb7cb3d7479d60980 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.423231:0:14758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7aa690f/0xb7cb3d7479d60980 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.423239:0:14758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7aa690f/0xb7cb3d7479d60980 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.423246:0:14758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7aa690f/0xb7cb3d7479d60980 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.423281:0:14758:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789081794.423896:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789081794.423905:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7aa690f/0xb7cb3d7479d60980 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.423914:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998a00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:1.0:1789081794.423918:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7aa690f/0xb7cb3d7479d60980 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.423950:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7aa690f/0xb7cb3d7479d60980 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.423968:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7aa690f/0xb7cb3d7479d60980 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.423975:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7aa690f/0xb7cb3d7479d60980 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.423991:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081794.423992:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081794.423994:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081794.424084:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789081794.424151:0:14758:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789081794.424157:0:14758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fac1aed6/0xb7cb3d7479d60987 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.424165:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1789081794.424168:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081794.424174:0:14758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fac1aed6/0xb7cb3d7479d60987 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.424183:0:14758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fac1aed6/0xb7cb3d7479d60987 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.424189:0:14758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fac1aed6/0xb7cb3d7479d60987 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.424197:0:14758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fac1aed6/0xb7cb3d7479d60987 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.424246:0:14758:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789081794.424699:0:14758:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789081794.424705:0:14758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d6098e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.424713:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1789081794.424724:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081794.424807:0:14758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d6098e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.424820:0:14758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d6098e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.424828:0:14758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d6098e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.424835:0:14758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d6098e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789081794.425298:0:5811:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:1.0:1789081794.425876:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789081794.425884:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fac1aed6/0xb7cb3d7479d60987 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.425893:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998e00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:1.0:1789081794.425898:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fac1aed6/0xb7cb3d7479d60987 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.425908:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fac1aed6/0xb7cb3d7479d60987 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.425935:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fac1aed6/0xb7cb3d7479d60987 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.425960:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fac1aed6/0xb7cb3d7479d60987 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.425979:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789081794.425983:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d6098e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.425990:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999600 already unused, calling callback (ffffffffc1784220) 00010000:00010000:1.0:1789081794.425993:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d6098e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.426000:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d6098e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.426011:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d6098e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.426018:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081794.426020:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081794.426022:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081794.426099:0:14758:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789081794.426105:0:14758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f4c6f33/0xb7cb3d7479d6098e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789081794.426720:0:14758:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789081794.426727:0:14758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009dc56b41/0xb7cb3d7479d60995 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.426858:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1789081794.426862:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081794.426869:0:14758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009dc56b41/0xb7cb3d7479d60995 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.426881:0:14758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009dc56b41/0xb7cb3d7479d60995 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.426896:0:14758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009dc56b41/0xb7cb3d7479d60995 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.426904:0:14758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009dc56b41/0xb7cb3d7479d60995 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.426935:0:14758:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789081794.427271:0:14758:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789081794.427277:0:14758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be9c5c2e/0xb7cb3d7479d6099c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.427285:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1789081794.427288:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081794.427293:0:14758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be9c5c2e/0xb7cb3d7479d6099c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.427302:0:14758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be9c5c2e/0xb7cb3d7479d6099c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.427310:0:14758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be9c5c2e/0xb7cb3d7479d6099c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.427317:0:14758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be9c5c2e/0xb7cb3d7479d6099c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.427334:0:14758:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789081794.427672:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789081794.427679:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009dc56b41/0xb7cb3d7479d60995 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081794.427693:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998800 already unused, calling callback (ffffffffc1784220) 00010000:00010000:2.0:1789081794.427697:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009dc56b41/0xb7cb3d7479d60995 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081794.427714:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009dc56b41/0xb7cb3d7479d60995 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081794.427741:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009dc56b41/0xb7cb3d7479d60995 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081794.427749:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009dc56b41/0xb7cb3d7479d60995 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081794.427770:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789081794.427773:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be9c5c2e/0xb7cb3d7479d6099c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081794.427780:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999400 already unused, calling callback (ffffffffc1784220) 00010000:00010000:2.0:1789081794.427783:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be9c5c2e/0xb7cb3d7479d6099c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081794.427791:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be9c5c2e/0xb7cb3d7479d6099c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081794.427801:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be9c5c2e/0xb7cb3d7479d6099c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081794.427813:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be9c5c2e/0xb7cb3d7479d6099c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081794.427824:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081794.427826:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081794.427827:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081794.428003:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1789081794.428200:0:14758:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:3.0:1789081794.428337:0:14758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10fada6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14144:x1875987821327616:12345-0@lo:5:osp-pre-0-0.0 Request processed in 81345us (81508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081794.428352:0:14758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789081794.429001:0:14144:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14144:1875987821327616:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789081794.429021:0:14144:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:1.0:1789081794.429073:0:14144:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14144:1875987821327744:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789081794.429128:0:14144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081794.429238:0:14144:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d17d30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789081794.429286:0:14759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821327744 00000100:00100000:2.0:1789081794.429295:0:14759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821327744 00000100:00100000:2.0:1789081794.429371:0:14759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789081794.429380:0:14759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10fada5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14144:x1875987821327744:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1789081794.429427:0:14759:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:1.0:1789081794.439958:0:14759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10fada5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14144:x1875987821327744:12345-0@lo:5:osp-pre-0-0.0 Request processed in 10573us (10823us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789081794.439972:0:14759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789081794.440355:0:14144:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14144:1875987821327744:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789081794.440374:0:14144:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:2.0:1789081794.468917:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789081794.939068:0:15423:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789081794.939072:0:15423:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1789081794.939221:0:15423:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9e10f9783000 00000020:01000004:3.0:1789081794.939239:0:15423:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789081794.939252:0:15423:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1789081794.939265:0:15423:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9e10f9220000) 00000020:00000080:3.0:1789081794.939280:0:15423:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789081794.957173:0:15423:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1789081794.957630:0:15423:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1789081794.958401:0:15423:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1789081794.958810:0:15423:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1789081794.959105:0:15423:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1789081794.959609:0:15423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 421: rc = 0 00100000:10000000:0.0:1789081794.959707:0:15423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 421: rc = 0 00100000:10000000:0.0:1789081794.959839:0:15423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 421: rc = 0 00100000:10000000:0.0:1789081794.961576:0:15423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 546: rc = 0 00100000:10000000:0.0:1789081794.961873:0:15423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 546: rc = 0 00100000:10000000:0.0:1789081794.962215:0:15423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 546: rc = 0 00100000:10000000:0.0:1789081794.962766:0:15423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 546: rc = 0 00100000:10000000:0.0:1789081794.963101:0:15423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 546: rc = 0 00100000:10000000:0.0:1789081794.963393:0:15423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 546: rc = 0 00000020:00000080:0.0:1789081794.965229:0:15423:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1789081794.965242:0:15423:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789081794.965253:0:15423:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb7cb3d7479d609aa 00000020:01000004:0.0:1789081794.965261:0:15423:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1789081794.965282:0:15423:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.117@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789081794.965286:0:15423:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.117@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789081794.965291:0:15423:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1789081794.965323:0:15423:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1789081794.965328:0:15423:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.117@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1789081794.973727:0:15423:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.117@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789081794.973785:0:15423:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.117@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1789081794.973790:0:15423:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789081794.973793:0:15423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789081794.973794:0:15423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789081794.973796:0:15423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789081794.973797:0:15423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789081794.973798:0:15423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789081794.973800:0:15423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789081794.973802:0:15423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789081794.973804:0:15423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789081794.973807:0:15423:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1789081794.973810:0:15423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789081794.973811:0:15423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789081794.973812:0:15423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789081794.973814:0:15423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789081794.973815:0:15423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789081794.973816:0:15423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789081794.973817:0:15423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789081794.973818:0:15423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789081794.973819:0:15423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789081794.973849:0:15423:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789081794.973874:0:15423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:15423:1875987821327872:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789081794.974032:0:15423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081794.974153:0:15423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c31ff600 going to sleep for 11 seconds 00000100:00100000:3.0:1789081794.974220:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821327872 00000100:00100000:3.0:1789081794.974228:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821327872 00000100:00100000:3.0:1789081794.974323:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789081794.974334:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+16:15423:x1875987821327872:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789081794.974376:0:14115:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789081794.974379:0:14115:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1789081794.974383:0:14115:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789081794.985165:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+16:15423:x1875987821327872:12345-0@lo:253:mount.lustre.0 Request processed in 10822us (11122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081794.985185:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789081794.985306:0:15423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:15423:1875987821327872:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789081794.985330:0:15423:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789081794.985334:0:15423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789081794.985353:0:15423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789081794.985355:0:15423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789081794.985356:0:15423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789081794.985358:0:15423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789081794.985359:0:15423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789081794.985361:0:15423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789081794.985363:0:15423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789081794.985365:0:15423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789081794.985387:0:15423:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e10f9783000 from lustre-OST0001 10000000:01000000:1.0:1789081794.985511:0:15423:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789081794.985516:0:15423:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789081794.985561:0:15423:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e10ff7d19c0 local copy 00010000:00010000:1.0:1789081794.985575:0:15423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0200/0xb7cb3d7479d60750 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d60757 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081794.985807:0:15423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:15423:1875987821328000:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789081794.985848:0:15423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081794.985883:0:15423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d0ff8600 going to sleep for 11 seconds 00000100:00100000:2.0:1789081794.986015:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821328000 00000100:00100000:2.0:1789081794.986022:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821328000 00000100:00100000:2.0:1789081794.986069:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789081794.986077:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+16:15423:x1875987821328000:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789081794.986238:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+16:15423:x1875987821328000:12345-0@lo:501:mount.lustre.0 Request processed in 160us (388us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789081794.986246:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789081794.986372:0:15423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:15423:1875987821328000:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789081794.986388:0:15423:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.117@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789081794.986688:0:15423:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.117@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789081794.986697:0:15423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0200/0xb7cb3d7479d60750 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d60757 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.986708:0:15423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd0200/0xb7cb3d7479d60750 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d60757 expref: -99 pid: 14103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789081794.986733:0:15423:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e10f9783000 10000000:01000000:1.0:1789081794.986737:0:15423:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789081794.986742:0:15423:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789081794.986744:0:15423:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789081794.986755:0:15423:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789081794.986758:0:15423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789081794.986786:0:15423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10e13aea00/0xb7cb3d7479d609b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.986795:0:15423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e10e13aea00/0xb7cb3d7479d609b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.986804:0:15423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e10e13aea00/0xb7cb3d7479d609b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081794.986820:0:15423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:15423:1875987821328128:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789081794.986853:0:15423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081794.986943:0:15423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d0ff8600 going to sleep for 11 seconds 00000100:00100000:3.0:1789081794.987111:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821328128 00000100:00100000:3.0:1789081794.987117:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821328128 00000100:00100000:3.0:1789081794.987197:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789081794.987206:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+16:15423:x1875987821328128:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789081794.987218:0:14115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081794.987242:0:14115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e1101999600/0xb7cb3d7479d609b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d609b1 expref: -99 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.987266:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e1101999600/0xb7cb3d7479d609b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d609b1 expref: 17 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.987278:0:14115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e1101999600/0xb7cb3d7479d609b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d609b1 expref: 17 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081794.987287:0:14115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101999600, rc 0) 00000100:00100000:3.0:1789081794.987330:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+17:15423:x1875987821328128:12345-0@lo:101:mount.lustre.0 Request processed in 124us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081794.987336:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789081794.987424:0:15423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:15423:1875987821328128:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789081794.987440:0:15423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e10e13aea00/0xb7cb3d7479d609b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d609b8 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081794.987449:0:15423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e10e13aea00/0xb7cb3d7479d609b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d609b8 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789081794.988185:0:15423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1789081794.989087:0:15423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789081794.989328:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1789081794.989375:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1789081794.989406:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1789081794.989449:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1789081794.989480:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1789081794.989511:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1789081794.989611:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1789081794.989628:0:15423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1789081794.989709:0:15423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:15423:1875987821328256:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789081794.989775:0:15423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081794.990229:0:15423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d0ff8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789081794.990312:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821328256 00000100:00100000:2.0:1789081794.990321:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821328256 00000100:00100000:2.0:1789081794.990361:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789081794.990370:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+17:15423:x1875987821328256:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789081794.990756:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+17:15423:x1875987821328256:12345-0@lo:501:mount.lustre.0 Request processed in 386us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081794.990773:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789081794.990977:0:15423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:15423:1875987821328256:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789081794.991019:0:15423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:15423:1875987821328384:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789081794.991061:0:15423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081794.991081:0:15423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d0ff8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789081794.991185:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821328384 00000100:00100000:2.0:1789081794.991191:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821328384 00000100:00100000:2.0:1789081794.991212:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789081794.991218:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+17:15423:x1875987821328384:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789081794.991556:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+17:15423:x1875987821328384:12345-0@lo:503:mount.lustre.0 Request processed in 337us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081794.991563:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789081794.991717:0:15423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:15423:1875987821328384:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789081794.992742:0:15423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789081794.992835:0:15423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:15423:1875987821328512:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789081794.992900:0:15423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081794.993000:0:15423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d0ff8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789081794.993124:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821328512 00000100:00100000:2.0:1789081794.993131:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821328512 00000100:00100000:2.0:1789081794.993163:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789081794.993170:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+17:15423:x1875987821328512:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789081794.993390:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+17:15423:x1875987821328512:12345-0@lo:502:mount.lustre.0 Request processed in 220us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081794.993401:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789081794.993600:0:15423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:15423:1875987821328512:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789081794.993850:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1789081794.993898:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1789081794.994058:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1789081794.994111:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1789081794.994150:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1789081794.994185:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1789081794.994234:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1789081794.994270:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1789081794.994338:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1789081794.994374:0:15423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:15423:1875987821328640:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789081794.994501:0:15423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081794.994611:0:15423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d0ff8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789081794.994681:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821328640 00000100:00100000:3.0:1789081794.994687:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821328640 00000100:00100000:0.0:1789081794.994786:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789081794.994798:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+17:15423:x1875987821328640:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789081794.994991:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+17:15423:x1875987821328640:12345-0@lo:502:mount.lustre.0 Request processed in 196us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081794.994998:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789081794.995091:0:15423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:15423:1875987821328640:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789081794.995167:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1789081794.995177:0:15423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1789081794.997775:0:15425:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789081794.997787:0:15425:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1789081794.997794:0:15425:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789081794.997796:0:15425:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789081794.997803:0:15425:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789081794.997820:0:15425:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9e10d1a00000) 00000020:00000080:2.0:1789081794.997843:0:15425:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789081794.997849:0:15425:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789081794.997997:0:15425:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e10f9783000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789081794.998005:0:15425:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789081794.998012:0:15425:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb7cb3d7479d609c6 00010000:00010000:3.0:1789081795.004783:0:15425:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1789081795.005302:0:15425:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1789081795.008016:0:15425:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1789081795.009487:0:15425:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789081795.009501:0:15425:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789081795.009508:0:15425:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789081795.009510:0:15425:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789081795.009514:0:15425:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789081795.009519:0:15425:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789081795.009520:0:15425:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789081795.009578:0:15425:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789081795.009581:0:15425:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789081795.009584:0:15425:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789081795.009587:0:15425:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789081795.009588:0:15425:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789081795.009590:0:15425:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789081795.009593:0:15425:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789081795.009594:0:15425:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789081795.009598:0:15425:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789081795.009657:0:15425:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789081795.009660:0:15425:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789081795.009662:0:15425:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789081795.009665:0:15425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1789081795.009929:0:15423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1789081795.009961:0:15423:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789081795.009985:0:15423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10e13aea00/0xb7cb3d7479d609b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d609b8 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081795.009997:0:15423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e10e13aea00/0xb7cb3d7479d609b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d609b8 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789081795.010005:0:15423:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e10f9783000 from 1 10000000:01000000:3.0:1789081795.010008:0:15423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789081795.010055:0:15423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101998600/0xb7cb3d7479d609cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081795.010078:0:15423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e1101998600/0xb7cb3d7479d609cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081795.010088:0:15423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e1101998600/0xb7cb3d7479d609cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081795.010112:0:15423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:15423:1875987821328768:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789081795.010179:0:15423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081795.010216:0:15423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e11010ab900 going to sleep for 11 seconds 00000100:00100000:2.0:1789081795.010370:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821328768 00000100:00100000:2.0:1789081795.010377:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821328768 00000100:00100000:2.0:1789081795.010508:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789081795.010519:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+17:15423:x1875987821328768:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789081795.010565:0:14116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081795.010580:0:14116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e1101774000/0xb7cb3d7479d609d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d609cd expref: -99 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081795.010604:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e1101774000/0xb7cb3d7479d609d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d609cd expref: 18 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081795.010617:0:14116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e1101774000/0xb7cb3d7479d609d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d609cd expref: 18 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081795.010625:0:14116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101774000, rc 0) 00000100:00100000:2.0:1789081795.010673:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+18:15423:x1875987821328768:12345-0@lo:101:mount.lustre.0 Request processed in 156us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081795.010680:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789081795.010784:0:15423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:15423:1875987821328768:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789081795.010799:0:15423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e1101998600/0xb7cb3d7479d609cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d609d4 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081795.010809:0:15423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e1101998600/0xb7cb3d7479d609cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d609d4 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789081795.011332:0:15423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1789081795.011633:0:15423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789081795.011858:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1789081795.011902:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1789081795.011975:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1789081795.011984:0:15423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1789081795.012057:0:15423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b27480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:15423:1875987821328896:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789081795.012114:0:15423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081795.012153:0:15423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c8e83300 going to sleep for 11 seconds 00000100:00100000:3.0:1789081795.012424:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821328896 00000100:00100000:3.0:1789081795.012432:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821328896 00000100:00100000:3.0:1789081795.012479:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789081795.012489:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+18:15423:x1875987821328896:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789081795.012725:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+18:15423:x1875987821328896:12345-0@lo:501:mount.lustre.0 Request processed in 238us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081795.012733:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789081795.013017:0:15423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b27480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:15423:1875987821328896:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789081795.013058:0:15423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b27480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:15423:1875987821329024:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789081795.013104:0:15423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081795.013141:0:15423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c8e83300 going to sleep for 11 seconds 00000100:00100000:3.0:1789081795.013189:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821329024 00000100:00100000:3.0:1789081795.013193:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821329024 00000100:00100000:3.0:1789081795.013269:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789081795.013277:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+18:15423:x1875987821329024:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789081795.013436:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+18:15423:x1875987821329024:12345-0@lo:503:mount.lustre.0 Request processed in 159us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081795.013444:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789081795.017260:0:15423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b27480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:15423:1875987821329024:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789081795.017844:0:15423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789081795.018060:0:15423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b27480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:15423:1875987821329152:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789081795.018141:0:15423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081795.020066:0:15423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c8e83300 going to sleep for 11 seconds 00000100:00100000:2.0:1789081795.021152:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821329152 00000100:00100000:2.0:1789081795.021163:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821329152 00000100:00100000:2.0:1789081795.021215:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789081795.021224:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+18:15423:x1875987821329152:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789081795.021610:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+18:15423:x1875987821329152:12345-0@lo:502:mount.lustre.0 Request processed in 386us (3469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081795.021619:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789081795.021842:0:15423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b27480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:15423:1875987821329152:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789081795.022221:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789081795.022281:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1789081795.022331:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1789081795.022366:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1789081795.022402:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1789081795.023254:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1789081795.023333:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1789081795.023372:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1789081795.023486:0:15423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:15423:1875987821329280:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789081795.023756:0:15423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081795.023808:0:15423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d12d8480 going to sleep for 11 seconds 00000100:00100000:0.0:1789081795.023862:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821329280 00000100:00100000:0.0:1789081795.023870:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821329280 00000100:00100000:0.0:1789081795.023933:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789081795.023943:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+18:15423:x1875987821329280:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789081795.024145:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+18:15423:x1875987821329280:12345-0@lo:502:mount.lustre.0 Request processed in 203us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081795.024153:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789081795.024298:0:15423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:15423:1875987821329280:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789081795.024400:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1789081795.024411:0:15423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1789081795.026721:0:15429:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789081795.026736:0:15429:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789081795.026738:0:15429:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789081795.026746:0:15429:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e10f9783000 00000020:00000080:1.0:1789081795.026748:0:15429:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789081795.026756:0:15429:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789081795.026759:0:15429:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789081795.026761:0:15429:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789081795.026763:0:15429:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789081795.026765:0:15429:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789081795.026767:0:15429:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789081795.026782:0:15429:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e10f9783000 00000020:00000080:1.0:1789081795.026784:0:15429:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789081795.026852:0:15429:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789081795.026856:0:15429:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789081795.026857:0:15429:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789081795.026860:0:15429:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789081795.026863:0:15429:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789081795.026864:0:15429:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789081795.026868:0:15429:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e10f9783000 00000020:00000080:1.0:1789081795.026870:0:15429:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789081795.026982:0:15429:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789081795.026987:0:15429:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789081795.026989:0:15429:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789081795.026993:0:15429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1789081795.027145:0:15423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1789081795.027176:0:15423:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789081795.027206:0:15423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101998600/0xb7cb3d7479d609cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d609d4 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081795.027227:0:15423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e1101998600/0xb7cb3d7479d609cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d609d4 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789081795.027286:0:15423:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789081795.027289:0:15423:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e10f9783000 10000000:01000000:3.0:1789081795.027293:0:15423:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e10f9783000 10000000:01000000:3.0:1789081795.027298:0:15423:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789081795.027304:0:15423:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e10f9783000 from 1 10000000:01000000:3.0:1789081795.027307:0:15423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789081795.027350:0:15423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101999400/0xb7cb3d7479d609db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081795.027358:0:15423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e1101999400/0xb7cb3d7479d609db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081795.027370:0:15423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e1101999400/0xb7cb3d7479d609db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081795.027395:0:15423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:15423:1875987821329408:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789081795.027766:0:15423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081795.027815:0:15423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e11010ab6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789081795.028592:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821329408 00000100:00100000:1.0:1789081795.028601:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821329408 00000100:00100000:1.0:1789081795.028656:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789081795.028666:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+18:15423:x1875987821329408:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789081795.028680:0:14116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081795.028694:0:14116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10e13afc00/0xb7cb3d7479d609e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d609db expref: -99 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081795.028721:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10e13afc00/0xb7cb3d7479d609e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d609db expref: 19 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081795.028731:0:14116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10e13afc00/0xb7cb3d7479d609e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d609db expref: 19 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081795.028740:0:14116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13afc00, rc 0) 00000100:00100000:1.0:1789081795.028793:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+19:15423:x1875987821329408:12345-0@lo:101:mount.lustre.0 Request processed in 127us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081795.028814:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789081795.028995:0:15423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:15423:1875987821329408:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789081795.029013:0:15423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e1101999400/0xb7cb3d7479d609db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d609e2 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081795.029023:0:15423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e1101999400/0xb7cb3d7479d609db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d609e2 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789081795.031801:0:15423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1789081795.034387:0:15423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789081795.036183:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789081795.036261:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789081795.036295:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789081795.036342:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789081795.036384:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789081795.036508:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789081795.036577:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789081795.036612:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789081795.036702:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789081795.036740:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789081795.036777:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789081795.036822:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789081795.036856:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789081795.036890:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789081795.037634:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789081795.037679:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789081795.037712:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789081795.037759:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789081795.037793:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789081795.037825:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789081795.038117:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789081795.038155:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789081795.038185:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789081795.038224:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789081795.038274:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1789081795.038303:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1789081795.038343:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1789081795.038380:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1789081795.038498:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1789081795.038839:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1789081795.040752:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1789081795.040816:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1789081795.040865:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1789081795.040974:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1789081795.041016:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1789081795.041060:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1789081795.041094:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1789081795.041201:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1789081795.041208:0:15423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1789081795.041323:0:15423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:15423:1875987821329536:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789081795.041400:0:15423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081795.041464:0:15423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d12d8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789081795.045578:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821329536 00000100:00100000:0.0:1789081795.045593:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821329536 00000100:00100000:0.0:1789081795.045653:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789081795.045663:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+19:15423:x1875987821329536:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789081795.046023:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+19:15423:x1875987821329536:12345-0@lo:501:mount.lustre.0 Request processed in 361us (4622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081795.046042:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789081795.047024:0:15423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:15423:1875987821329536:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789081795.047080:0:15423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:15423:1875987821329664:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789081795.047136:0:15423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081795.047176:0:15423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d12d8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789081795.047541:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821329664 00000100:00100000:0.0:1789081795.047548:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821329664 00000100:00100000:0.0:1789081795.047589:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789081795.047597:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+19:15423:x1875987821329664:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789081795.047792:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+19:15423:x1875987821329664:12345-0@lo:503:mount.lustre.0 Request processed in 195us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081795.047800:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789081795.048025:0:15423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:15423:1875987821329664:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789081795.052405:0:15423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789081795.053636:0:15423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:15423:1875987821329792:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789081795.053719:0:15423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081795.053774:0:15423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d12d8480 going to sleep for 11 seconds 00000100:00100000:0.0:1789081795.055692:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821329792 00000100:00100000:0.0:1789081795.055707:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821329792 00000100:00100000:0.0:1789081795.055768:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789081795.055778:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+19:15423:x1875987821329792:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789081795.056070:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+19:15423:x1875987821329792:12345-0@lo:502:mount.lustre.0 Request processed in 294us (2350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081795.056079:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789081795.057249:0:15423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:15423:1875987821329792:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789081795.057596:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789081795.057659:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789081795.057692:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789081795.057750:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789081795.057790:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789081795.057840:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789081795.057875:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789081795.058052:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789081795.058111:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789081795.058152:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789081795.058186:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789081795.058235:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789081795.058269:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789081795.058305:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789081795.058372:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789081795.058477:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789081795.058518:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789081795.058588:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789081795.058619:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789081795.058645:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789081795.058686:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789081795.058719:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789081795.058755:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789081795.058820:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789081795.058860:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1789081795.058893:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1789081795.059112:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1789081795.059149:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1789081795.059183:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1789081795.059229:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1789081795.059280:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1789081795.059315:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1789081795.059347:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1789081795.059395:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1789081795.060666:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1789081795.060753:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1789081795.060800:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1789081795.060834:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1789081795.065180:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1789081795.065276:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1789081795.065329:0:15423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:15423:1875987821329920:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789081795.065405:0:15423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081795.065680:0:15423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d12d8480 going to sleep for 11 seconds 00000100:00100000:3.0:1789081795.072305:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821329920 00000100:00100000:3.0:1789081795.072321:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821329920 00000100:00100000:3.0:1789081795.072384:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789081795.072394:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+19:15423:x1875987821329920:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789081795.073044:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+19:15423:x1875987821329920:12345-0@lo:502:mount.lustre.0 Request processed in 649us (7637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081795.073056:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789081795.075565:0:15423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:15423:1875987821329920:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789081795.075713:0:15423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1789081795.075728:0:15423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1789081795.080226:0:15434:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789081795.080240:0:15434:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9e10f9693380) 00000020:00000080:1.0:1789081795.080259:0:15434:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1789081795.083260:0:15434:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e10f9783000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789081795.083270:0:15434:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e10f9783000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789081795.083273:0:15434:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e10f9783000 3 00010000:00080000:0.0:1789081795.083316:0:15434:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e0fc2da2800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.117@tcp at head 00010000:00010000:0.0:1789081795.093578:0:15434:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1789081795.093682:0:15434:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1789081795.093724:0:15434:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789081795.093736:0:15434:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xb7cb3d7479d609f0 00000100:00080000:0.0:1789081795.093747:0:15434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789081795.093753:0:15434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e0fc2da2800 using connection 192.168.201.117@tcp/0@lo 00000100:00100000:0.0:1789081795.093800:0:15434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e10f9b26a00 x1875987821330048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789081795.093834:0:15434:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789081795.096156:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1875987821330048:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789081795.096237:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1789081795.096466:0:15434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:0.0:1789081795.097185:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821330048 00000100:00100000:0.0:1789081795.097197:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821330048 00000100:00100000:0.0:1789081795.097245:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789081795.097253:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1875987821330048:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789081795.097283:0:14123:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 461 last 0 00000020:00000080:0.0:1789081795.097319:0:14123:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xb7cb3d7479d609f7 00000004:00100000:0.0:1789081795.097335:0:14123:0:(mdt_handler.c:7406:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789081795.097366:0:14123:0:(import.c:65:import_set_state_nolock()) ffff9e0fc2da3000 : changing import state from RECOVER to FULL 00000020:01000000:2.0:1789081795.098628:0:15423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1789081795.098677:0:15423:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789081795.098703:0:15423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101999400/0xb7cb3d7479d609db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d609e2 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081795.098714:0:15423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e1101999400/0xb7cb3d7479d609db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d609e2 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789081795.098764:0:15423:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789081795.098766:0:15423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789081795.098768:0:15423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789081795.098769:0:15423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789081795.098770:0:15423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789081795.098771:0:15423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789081795.098773:0:15423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789081795.098775:0:15423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789081795.098776:0:15423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789081795.098780:0:15423:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1789081795.098783:0:15423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789081795.098784:0:15423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789081795.098785:0:15423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789081795.098786:0:15423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789081795.098787:0:15423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789081795.098788:0:15423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789081795.098789:0:15423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789081795.098790:0:15423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789081795.098791:0:15423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789081795.098816:0:15423:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789081795.098834:0:15423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:15423:1875987821330176:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789081795.098907:0:15423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081795.098973:0:15423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d17d3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789081795.099001:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875987821330048:12345-0@lo:38:llog_process_th.0 Request processed in 1747us (2762us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081795.099012:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789081795.099019:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e10f9b26a00 x1875987821330048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789081805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789081795.099029:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789081795.099038:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1789081795.099045:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789081795.099055:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789081795.099058:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e0fc2da2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789081795.099064:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1875987821330048:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789081795.099306:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821330176 00000100:00100000:3.0:1789081795.099314:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821330176 00000100:00100000:3.0:1789081795.103700:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789081795.103719:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+19:15423:x1875987821330176:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789081795.103757:0:14115:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789081795.103771:0:14115:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789081795.163053:0:14115:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789081795.163076:0:14115:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789081795.163996:0:14137:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789081795.164003:0:14137:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789081795.164028:0:14137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e1101982400/0xb7cb3d7479d609fe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081795.164047:0:14137:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e1101983800/0xb7cb3d7479d608d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d608ca expref: 19 pid: 14114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081795.164056:0:14137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e1101982400/0xb7cb3d7479d609fe lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081795.164097:0:14137:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e1101983800/0xb7cb3d7479d608d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb7cb3d7479d608ca expref: 19 pid: 14114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081795.164112:0:14137:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e1101983800/0xb7cb3d7479d608d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb7cb3d7479d608ca expref: 19 pid: 14114 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081795.164147:0:14137:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b26a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14137:1875987821330304:0@lo:104: 00000100:00100000:0.0:1789081795.164212:0:14137:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081795.164265:0:14137:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d1612180 going to sleep for 11 seconds 00000100:00100000:1.0:1789081795.166013:0:14105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821330304 00000100:00100000:1.0:1789081795.166030:0:14105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821330304 00000100:00100000:0.0:1789081795.166172:0:14105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789081795.166184:0:14105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+3:14137:x1875987821330304:12345-0@lo:104: 00010000:00010000:0.0:1789081795.166201:0:14105:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.117@tcp lock: ffff9e1101999c00/0xb7cb3d7479d608ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d608d1 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081795.166295:0:14105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789081795.166301:0:14105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+3:14137:x1875987821330304:12345-0@lo:104: Request processed in 121us (2089us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081795.166309:0:14105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789081795.167002:0:14137:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b26a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14137:1875987821330304:0@lo:104: 00010000:00010000:1.0:1789081795.167031:0:14137:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e1101982400/0xb7cb3d7479d609fe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081795.167103:0:14109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789081795.167111:0:14109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e1101999c00/0xb7cb3d7479d608ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d608d1 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081795.167130:0:14109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999c00 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:2.0:1789081795.167136:0:14109:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e1101999c00/0xb7cb3d7479d608ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb7cb3d7479d608d1 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081795.167146:0:14109:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e1101999c00/0xb7cb3d7479d608ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb7cb3d7479d608d1 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789081795.167154:0:14109:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e1101999c00/0xb7cb3d7479d608ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb7cb3d7479d608d1 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789081795.167160:0:14109:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789081795.167208:0:14109:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e1101999c00/0xb7cb3d7479d608ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d608d1 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081795.167215:0:14109:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789081795.167244:0:14109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e1101999c00/0xb7cb3d7479d608ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d608d1 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081795.167251:0:14109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e1101999c00/0xb7cb3d7479d608ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d608d1 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081795.167268:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081795.167270:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081795.167287:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789081795.167405:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789081795.167421:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:3304:1875987821330432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789081795.167472:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081795.167630:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821330432 00000100:00100000:2.0:1789081795.167637:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821330432 00010000:00010000:2.0:1789081795.167664:0:14108:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e1101983800/0xb7cb3d7479d608d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d608ca expref: 20 pid: 14114 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081795.167695:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789081795.167703:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10fada6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+20:3304:x1875987821330432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789081795.167715:0:14108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789081795.167720:0:14108:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e1101983800/0xb7cb3d7479d608d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d608ca expref: 20 pid: 14114 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081795.167731:0:14108:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e1101983800/0xb7cb3d7479d608d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb7cb3d7479d608ca expref: 20 pid: 14114 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081795.167745:0:14108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e1101983800/0xb7cb3d7479d608d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb7cb3d7479d608ca expref: 20 pid: 14114 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081795.167758:0:14108:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e1101982400/0xb7cb3d7479d609fe lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081795.167767:0:14108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e1101982400/0xb7cb3d7479d609fe lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789081795.167782:0:14108:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003779210s 00010000:00010000:2.0:1789081795.167787:0:14108:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e1101982400/0xb7cb3d7479d609fe lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081795.167794:0:14108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e1101982400/0xb7cb3d7479d609fe lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081795.167801:0:14108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e1101982400/0xb7cb3d7479d609fe lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081795.167814:0:14108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e1101982400/0xb7cb3d7479d609fe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081795.167819:0:14108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101982400 already unused, calling callback (ffffffffc1784220) 00010000:00010000:2.0:1789081795.167822:0:14108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e1101982400/0xb7cb3d7479d609fe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081795.167829:0:14108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e1101982400/0xb7cb3d7479d609fe lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081795.167841:0:14108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e1101982400/0xb7cb3d7479d609fe lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081795.167851:0:14108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789081795.167884:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10fada6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+19:3304:x1875987821330432:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081795.167892:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789081795.167979:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:3304:1875987821330432:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789081795.167998:0:14137:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e1101982400/0xb7cb3d7479d609fe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081795.168005:0:14137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e1101982400/0xb7cb3d7479d609fe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081795.168022:0:14137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e1101982400/0xb7cb3d7479d609fe lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081795.197013:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+18:15423:x1875987821330176:12345-0@lo:253:mount.lustre.0 Request processed in 93290us (98095us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081795.197029:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789081795.197188:0:15423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:15423:1875987821330176:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789081795.197203:0:15423:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789081795.197206:0:15423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789081795.197207:0:15423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789081795.197209:0:15423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789081795.197210:0:15423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789081795.197211:0:15423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789081795.197212:0:15423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789081795.197214:0:15423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789081795.197216:0:15423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789081795.197217:0:15423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789081795.197231:0:15423:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789081795.203373:0:15423:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789081795.205007:0:15423:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789081795.205275:0:15423:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789081795.205440:0:15423:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789081795.206894:0:15423:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789081795.207951:0:15423:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789081795.210842:0:15423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1789081795.279090:0:15423:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789081795.279100:0:15423:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789081795.279132:0:15423:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789081795.279202:0:15423:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.117@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789081795.279219:0:15423:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789081795.279249:0:15423:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1789081795.484870:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081796.509416:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789081796.578917:0:14118:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789081796.578925:0:14118:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e10ff613800 from 8 10000000:01000000:1.0:1789081796.578931:0:14118:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789081796.578975:0:14118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10e13aec00/0xb7cb3d7479d60a05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081796.578987:0:14118:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e10e13aec00/0xb7cb3d7479d60a05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081796.578997:0:14118:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e10e13aec00/0xb7cb3d7479d60a05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081796.579021:0:14118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14118:1875987821330560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789081796.579090:0:14118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081796.579140:0:14118:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c7c32780 going to sleep for 11 seconds 00000100:00100000:1.0:1789081796.579163:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821330560 00000100:00100000:1.0:1789081796.579169:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821330560 00000100:00100000:1.0:1789081796.580839:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789081796.580858:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+18:14118:x1875987821330560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789081796.580875:0:14114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081796.580903:0:14114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10e13afe00/0xb7cb3d7479d60a0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d60a05 expref: -99 pid: 14114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081796.580934:0:14114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10e13afe00/0xb7cb3d7479d60a0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d60a05 expref: 19 pid: 14114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081796.580955:0:14114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10e13afe00/0xb7cb3d7479d60a0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d60a05 expref: 19 pid: 14114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081796.580965:0:14114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13afe00, rc 0) 00000100:00100000:1.0:1789081796.581038:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+19:14118:x1875987821330560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (1947us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081796.581046:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789081796.581107:0:14118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14118:1875987821330560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789081796.581126:0:14118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e10e13aec00/0xb7cb3d7479d60a05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d60a0c expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081796.581136:0:14118:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e10e13aec00/0xb7cb3d7479d60a05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d60a0c expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081796.581195:0:14118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14118:1875987821330688:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789081796.581232:0:14118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081796.581266:0:14118:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c7c32780 going to sleep for 11 seconds 00000100:00100000:2.0:1789081796.587711:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821330688 00000100:00100000:2.0:1789081796.587728:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821330688 00000100:00100000:2.0:1789081796.587787:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789081796.587797:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+19:14118:x1875987821330688:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789081796.587826:0:14115:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789081796.587848:0:14115:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789081796.587851:0:14115:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1789081796.588000:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+19:14118:x1875987821330688:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 204us (6766us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081796.588008:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789081796.593262:0:14118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14118:1875987821330688:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789081796.593352:0:14118:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789081796.593365:0:14118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10e13aec00/0xb7cb3d7479d60a05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d60a0c expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081796.593375:0:14118:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e10e13aec00/0xb7cb3d7479d60a05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d60a0c expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1789081796.663595:0:6607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1789081796.663638:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:3.0:1789081797.532910:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081798.558517:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789081799.516761:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821330816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789081799.516861:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081799.517004:0:14760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821330816 00000100:00100000:2.0:1789081799.517013:0:14760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821330816 00000100:00100000:2.0:1789081799.517097:0:14760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789081799.517108:0:14760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10fada5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821330816:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789081799.517135:0:14117:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1789081799.517147:0:14760:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789081799.521740:0:14760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10fada5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821330816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4623us (4868us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081799.521756:0:14760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789081799.522015:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1789081799.522045:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821330816:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789081799.583861:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789081800.540715:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789081800.540721:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789081800.540725:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e10ff77b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789081800.540733:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 461 00000100:00080000:3.0:1789081800.540738:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789081800.540745:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e10ff77b000 using connection 192.168.201.117@tcp/0@lo 00000100:00100000:3.0:1789081800.540770:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e10f5c00000 x1875987821331200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789081800.540884:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:3305:1875987821330944:0@lo:400:kworker.0 00000100:00100000:3.0:1789081800.540960:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081800.541013:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875987821331584:0@lo:400:kworker.0 00000100:00100000:3.0:1789081800.541042:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081800.544451:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821331072:0@lo:400:kworker.0 00000100:00100000:3.0:1789081800.544516:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081800.544578:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875987821331200:0@lo:8:kworker.0 00000100:00100000:3.0:1789081800.544612:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081800.544654:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875987821331328:0@lo:400:kworker.0 00000100:00100000:3.0:1789081800.544681:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081800.544701:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789081800.544709:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875987821331456:0@lo:400:kworker.0 00000100:00100000:3.0:1789081800.544732:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081800.544784:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821330944 00000100:00100000:3.0:1789081800.544792:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821330944 00000100:00100000:3.0:1789081800.544853:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789081800.544862:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+19:3305:x1875987821330944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081800.544923:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+19:3305:x1875987821330944:12345-0@lo:400:kworker.0 Request processed in 62us (3963us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081800.544930:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789081800.544970:0:14756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821331072 00000100:00100000:3.0:1789081800.544974:0:14756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821331072 00000100:00100000:3.0:1789081800.544997:0:14756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821331200 00000100:00100000:3.0:1789081800.545000:0:14756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821331200 00000100:00100000:3.0:1789081800.545011:0:14756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789081800.545017:0:14756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821331072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081800.545054:0:14756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821331072:12345-0@lo:400:kworker.0 Request processed in 37us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081800.545061:0:14756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789081800.545073:0:14756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789081800.545077:0:14756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1875987821331200:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789081800.545288:0:14756:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 467 last 0 00000020:00000080:3.0:1789081800.545325:0:14756:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb7cb3d7479d60a13 00002000:00100000:3.0:1789081800.545339:0:14756:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9e0fc21ab800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113719 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789081800.545343:0:14756:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1789081800.545346:0:14756:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789081800.545740:0:14756:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789081800.545766:0:14756:0:(import.c:65:import_set_state_nolock()) ffff9e0fc21aa000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789081800.545814:0:14756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1875987821331200:12345-0@lo:8:kworker.0 Request processed in 734us (1200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081800.545832:0:14756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789081800.545879:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821331072:0@lo:400:kworker.0 00010000:00080000:3.0:1789081800.545917:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10f5c00000 x1875987821331200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789081825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789081800.545937:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789081800.545945:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789081800.545953:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789081800.545957:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789081800.545960:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9e10ff77b000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789081800.545976:0:3302:0:(osp_dev.c:1791:osp_import_event()) got connected 00000100:00100000:3.0:1789081800.545981:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875987821331200:0@lo:8:kworker.0 00000004:00080000:3.0:1789081800.546026:0:14146:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:3.0:1789081800.546044:0:14146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c02d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14146:1875987821331840:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789081800.546071:0:14146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081800.546087:0:14146:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c5ec5180 going to sleep for 11 seconds 00000100:00100000:1.0:1789081800.546225:0:15260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821331584 00000100:00100000:1.0:1789081800.546232:0:15260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821331584 00000100:00100000:1.0:1789081800.546270:0:15260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821331328 00000100:00100000:1.0:1789081800.546274:0:15260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821331328 00000100:00100000:1.0:1789081800.546286:0:15260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821331456 00000100:00100000:1.0:1789081800.546289:0:15260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821331456 00000100:00100000:1.0:1789081800.546311:0:15260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789081800.546320:0:15260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875987821331584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081800.546363:0:15260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875987821331584:12345-0@lo:400:kworker.0 Request processed in 45us (5319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081800.546369:0:15260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789081800.546383:0:15260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789081800.546390:0:15260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875987821331328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081800.546426:0:15260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875987821331328:12345-0@lo:400:kworker.0 Request processed in 37us (1744us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081800.546433:0:15260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789081800.546445:0:15260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789081800.546451:0:15260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875987821331456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081800.546478:0:15260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875987821331456:12345-0@lo:400:kworker.0 Request processed in 28us (1746us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081800.546485:0:15260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789081800.546599:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821331712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789081800.546835:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081800.546878:0:14756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821331840 00000100:00100000:3.0:1789081800.546883:0:14756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821331840 00000100:00100000:3.0:1789081800.546910:0:14756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789081800.546915:0:14756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14146:x1875987821331840:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789081800.547143:0:14145:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789081800.547551:0:14145:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 467430026202ns, next at 0ns, rc = 0 00000100:00100000:1.0:1789081800.548220:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821331712 00000100:00100000:1.0:1789081800.548231:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821331712 00000100:00100000:1.0:1789081800.548287:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789081800.548295:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875987821331712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789081800.548327:0:14761:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789081800.548385:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875987821331712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (1550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081800.548391:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789081800.548583:0:14117:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789081800.548588:0:14117:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00080000:3.0:1789081800.558400:0:14756:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1789081800.558413:0:14756:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1789081800.558418:0:14756:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00010000:00080000:0.0:1789081800.565642:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10f5c00a80 x1875987821331456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789081816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081800.565665:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875987821331456:0@lo:400:kworker.0 00010000:00080000:0.0:1789081800.565680:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10f5c03100 x1875987821331328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789081816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081800.565688:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875987821331328:0@lo:400:kworker.0 00010000:00080000:0.0:1789081800.565751:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10f5c03480 x1875987821331584/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789081816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789081800.565771:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875987821331584:0@lo:400:kworker.0 00000100:00100000:0.0:1789081800.565795:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:3305:1875987821330944:0@lo:400:kworker.0 00010000:00080000:2.0:1789081800.566006:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e10f5c00000 x1875987821331712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789081816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789081800.566025:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821331712:0@lo:13:osp-pre-1-0.0 00002000:00010000:2.0:1789081800.575115:0:14756:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789081800.575129:0:14756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004693a167/0xb7cb3d7479d60a1a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.575160:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=467s v=(0 0) 00010000:00010000:2.0:1789081800.575165:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789081800.575172:0:14756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004693a167/0xb7cb3d7479d60a1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.575192:0:14756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004693a167/0xb7cb3d7479d60a1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.575203:0:14756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004693a167/0xb7cb3d7479d60a1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.575212:0:14756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004693a167/0xb7cb3d7479d60a1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.575233:0:14756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789081800.575733:0:14756:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789081800.575739:0:14756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088569b46/0xb7cb3d7479d60a21 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.575747:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=467s v=(0 0) 00010000:00010000:2.0:1789081800.575751:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789081800.575755:0:14756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088569b46/0xb7cb3d7479d60a21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.575764:0:14756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088569b46/0xb7cb3d7479d60a21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.575784:0:14756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088569b46/0xb7cb3d7479d60a21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.575791:0:14756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088569b46/0xb7cb3d7479d60a21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.575805:0:14756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789081800.575826:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789081800.575833:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004693a167/0xb7cb3d7479d60a1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.575841:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101775600 already unused, calling callback (ffffffffc1784220) 00010000:00010000:2.0:1789081800.575846:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004693a167/0xb7cb3d7479d60a1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.575855:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004693a167/0xb7cb3d7479d60a1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.575873:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004693a167/0xb7cb3d7479d60a1a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.575881:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004693a167/0xb7cb3d7479d60a1a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.575897:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789081800.575907:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088569b46/0xb7cb3d7479d60a21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.575913:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101774c00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:2.0:1789081800.575916:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088569b46/0xb7cb3d7479d60a21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.575925:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088569b46/0xb7cb3d7479d60a21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.575935:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088569b46/0xb7cb3d7479d60a21 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.575941:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088569b46/0xb7cb3d7479d60a21 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.575952:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081800.575953:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081800.575955:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789081800.576332:0:14756:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789081800.576337:0:14756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000784b0e4c/0xb7cb3d7479d60a28 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.576346:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=467s v=(0 0) 00010000:00010000:2.0:1789081800.576349:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789081800.576353:0:14756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000784b0e4c/0xb7cb3d7479d60a28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.576371:0:14756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000784b0e4c/0xb7cb3d7479d60a28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.576379:0:14756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000784b0e4c/0xb7cb3d7479d60a28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.576386:0:14756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000784b0e4c/0xb7cb3d7479d60a28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.576399:0:14756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789081800.576406:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789081800.576409:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000784b0e4c/0xb7cb3d7479d60a28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.576414:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101775a00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:2.0:1789081800.576417:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000784b0e4c/0xb7cb3d7479d60a28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.576423:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000784b0e4c/0xb7cb3d7479d60a28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.576433:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000784b0e4c/0xb7cb3d7479d60a28 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.576440:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000784b0e4c/0xb7cb3d7479d60a28 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.576458:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081800.576459:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081800.576461:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789081800.576914:0:14756:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789081800.576920:0:14756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000757dbbb4/0xb7cb3d7479d60a2f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.576929:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=467s v=(0 0) 00010000:00010000:2.0:1789081800.576933:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789081800.576944:0:14756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000757dbbb4/0xb7cb3d7479d60a2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.576966:0:14756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000757dbbb4/0xb7cb3d7479d60a2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.576974:0:14756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000757dbbb4/0xb7cb3d7479d60a2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.576987:0:14756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000757dbbb4/0xb7cb3d7479d60a2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.577002:0:14756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789081800.577015:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789081800.577018:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000757dbbb4/0xb7cb3d7479d60a2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.577036:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101775c00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:2.0:1789081800.577040:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000757dbbb4/0xb7cb3d7479d60a2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.577048:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000757dbbb4/0xb7cb3d7479d60a2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.577066:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000757dbbb4/0xb7cb3d7479d60a2f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.577072:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000757dbbb4/0xb7cb3d7479d60a2f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.577092:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081800.577094:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081800.577095:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789081800.577517:0:14756:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789081800.577547:0:14756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a9e5259/0xb7cb3d7479d60a36 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.577557:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=467s v=(0 0) 00010000:00010000:2.0:1789081800.577561:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789081800.577565:0:14756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a9e5259/0xb7cb3d7479d60a36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.577575:0:14756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a9e5259/0xb7cb3d7479d60a36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.577589:0:14756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a9e5259/0xb7cb3d7479d60a36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.577597:0:14756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a9e5259/0xb7cb3d7479d60a36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.577610:0:14756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789081800.577619:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789081800.577622:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a9e5259/0xb7cb3d7479d60a36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.577628:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101774400 already unused, calling callback (ffffffffc1784220) 00010000:00010000:2.0:1789081800.577631:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a9e5259/0xb7cb3d7479d60a36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.577639:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a9e5259/0xb7cb3d7479d60a36 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.577650:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a9e5259/0xb7cb3d7479d60a36 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.577657:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a9e5259/0xb7cb3d7479d60a36 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.577670:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081800.577677:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081800.577679:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789081800.582476:0:14756:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789081800.582504:0:14756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b1d0279/0xb7cb3d7479d60a3d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.582538:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=467s v=(0 0) 00010000:00010000:2.0:1789081800.582544:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789081800.582552:0:14756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b1d0279/0xb7cb3d7479d60a3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.582567:0:14756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b1d0279/0xb7cb3d7479d60a3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.582578:0:14756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b1d0279/0xb7cb3d7479d60a3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.582586:0:14756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b1d0279/0xb7cb3d7479d60a3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.582611:0:14756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789081800.588738:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789081800.588755:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b1d0279/0xb7cb3d7479d60a3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.588771:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101775200 already unused, calling callback (ffffffffc1784220) 00010000:00010000:2.0:1789081800.588777:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b1d0279/0xb7cb3d7479d60a3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.588806:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b1d0279/0xb7cb3d7479d60a3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.588843:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b1d0279/0xb7cb3d7479d60a3d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.588852:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b1d0279/0xb7cb3d7479d60a3d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.588874:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081800.588876:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081800.588878:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081800.590783:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789081800.599397:0:14756:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789081800.599409:0:14756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc2efcf1/0xb7cb3d7479d60a44 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.599427:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=467s v=(0 0) 00010000:00010000:2.0:1789081800.599432:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789081800.599438:0:14756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc2efcf1/0xb7cb3d7479d60a44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.599453:0:14756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc2efcf1/0xb7cb3d7479d60a44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.599464:0:14756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc2efcf1/0xb7cb3d7479d60a44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.599478:0:14756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc2efcf1/0xb7cb3d7479d60a44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.599496:0:14756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789081800.599509:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789081800.599515:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc2efcf1/0xb7cb3d7479d60a44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.599548:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101775000 already unused, calling callback (ffffffffc1784220) 00010000:00010000:2.0:1789081800.599553:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc2efcf1/0xb7cb3d7479d60a44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.599563:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc2efcf1/0xb7cb3d7479d60a44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.599579:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc2efcf1/0xb7cb3d7479d60a44 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.599587:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc2efcf1/0xb7cb3d7479d60a44 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.599605:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081800.599606:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081800.599608:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789081800.603792:0:14756:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789081800.603814:0:14756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfe73047/0xb7cb3d7479d60a4b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.607011:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081800.616683:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=467s v=(0 0) 00010000:00010000:2.0:1789081800.616689:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789081800.616697:0:14756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfe73047/0xb7cb3d7479d60a4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.616714:0:14756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfe73047/0xb7cb3d7479d60a4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.616726:0:14756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfe73047/0xb7cb3d7479d60a4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.616734:0:14756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dfe73047/0xb7cb3d7479d60a4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.633596:0:14756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789081800.633633:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789081800.633644:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dfe73047/0xb7cb3d7479d60a4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.633659:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101774e00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:2.0:1789081800.633665:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfe73047/0xb7cb3d7479d60a4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.633677:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfe73047/0xb7cb3d7479d60a4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.633712:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dfe73047/0xb7cb3d7479d60a4b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.633737:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfe73047/0xb7cb3d7479d60a4b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.633764:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081800.633767:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081800.633769:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789081800.634386:0:14756:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789081800.634393:0:14756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b1d0279/0xb7cb3d7479d60a52 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.634405:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=467s v=(0 0) 00010000:00010000:2.0:1789081800.634409:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789081800.634415:0:14756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b1d0279/0xb7cb3d7479d60a52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.634426:0:14756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b1d0279/0xb7cb3d7479d60a52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.634435:0:14756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b1d0279/0xb7cb3d7479d60a52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.634442:0:14756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b1d0279/0xb7cb3d7479d60a52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.634472:0:14756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789081800.634895:0:14756:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789081800.634901:0:14756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a9e5259/0xb7cb3d7479d60a59 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.634910:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=467s v=(0 0) 00010000:00010000:2.0:1789081800.634913:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789081800.634917:0:14756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a9e5259/0xb7cb3d7479d60a59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.634925:0:14756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a9e5259/0xb7cb3d7479d60a59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.634932:0:14756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a9e5259/0xb7cb3d7479d60a59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.634939:0:14756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a9e5259/0xb7cb3d7479d60a59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.634954:0:14756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789081800.634965:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789081800.634969:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b1d0279/0xb7cb3d7479d60a52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.634975:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101775200 already unused, calling callback (ffffffffc1784220) 00010000:00010000:2.0:1789081800.634985:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b1d0279/0xb7cb3d7479d60a52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.634993:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b1d0279/0xb7cb3d7479d60a52 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.635007:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b1d0279/0xb7cb3d7479d60a52 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.635013:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b1d0279/0xb7cb3d7479d60a52 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.635026:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789081800.635029:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a9e5259/0xb7cb3d7479d60a59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.635035:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101774400 already unused, calling callback (ffffffffc1784220) 00010000:00010000:2.0:1789081800.635038:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a9e5259/0xb7cb3d7479d60a59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.635044:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a9e5259/0xb7cb3d7479d60a59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.635054:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a9e5259/0xb7cb3d7479d60a59 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.635060:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a9e5259/0xb7cb3d7479d60a59 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.635079:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081800.635080:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081800.635082:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789081800.635476:0:14756:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789081800.635482:0:14756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000757dbbb4/0xb7cb3d7479d60a60 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.635491:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=467s v=(0 0) 00010000:00010000:2.0:1789081800.635494:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789081800.635499:0:14756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000757dbbb4/0xb7cb3d7479d60a60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.635509:0:14756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000757dbbb4/0xb7cb3d7479d60a60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.635517:0:14756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000757dbbb4/0xb7cb3d7479d60a60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.635548:0:14756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000757dbbb4/0xb7cb3d7479d60a60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.635562:0:14756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789081800.635570:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789081800.635574:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000757dbbb4/0xb7cb3d7479d60a60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.635593:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101775c00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:2.0:1789081800.635596:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000757dbbb4/0xb7cb3d7479d60a60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.635603:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000757dbbb4/0xb7cb3d7479d60a60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.635614:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000757dbbb4/0xb7cb3d7479d60a60 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.635620:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000757dbbb4/0xb7cb3d7479d60a60 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.635634:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081800.635636:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081800.635638:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789081800.636053:0:14756:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789081800.636060:0:14756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000784b0e4c/0xb7cb3d7479d60a67 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.636069:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=467s v=(0 0) 00010000:00010000:2.0:1789081800.636072:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789081800.636077:0:14756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000784b0e4c/0xb7cb3d7479d60a67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.636087:0:14756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000784b0e4c/0xb7cb3d7479d60a67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.636101:0:14756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000784b0e4c/0xb7cb3d7479d60a67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.636108:0:14756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000784b0e4c/0xb7cb3d7479d60a67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.636122:0:14756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789081800.636130:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789081800.636134:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000784b0e4c/0xb7cb3d7479d60a67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.636141:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101775a00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:2.0:1789081800.636145:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000784b0e4c/0xb7cb3d7479d60a67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.636153:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000784b0e4c/0xb7cb3d7479d60a67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.636164:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000784b0e4c/0xb7cb3d7479d60a67 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.636171:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000784b0e4c/0xb7cb3d7479d60a67 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.636183:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081800.636191:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081800.636193:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789081800.636615:0:14756:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789081800.636621:0:14756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088569b46/0xb7cb3d7479d60a6e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.636630:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=467s v=(0 0) 00010000:00010000:2.0:1789081800.636633:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789081800.636637:0:14756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088569b46/0xb7cb3d7479d60a6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.636646:0:14756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088569b46/0xb7cb3d7479d60a6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.636654:0:14756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088569b46/0xb7cb3d7479d60a6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.636661:0:14756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088569b46/0xb7cb3d7479d60a6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.636674:0:14756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789081800.636682:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789081800.636686:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088569b46/0xb7cb3d7479d60a6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.636693:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101774c00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:2.0:1789081800.636696:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088569b46/0xb7cb3d7479d60a6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.636713:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088569b46/0xb7cb3d7479d60a6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.636724:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088569b46/0xb7cb3d7479d60a6e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.636731:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088569b46/0xb7cb3d7479d60a6e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.636744:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081800.636746:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081800.636747:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081800.638790:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789081800.643220:0:14756:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789081800.643233:0:14756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fac1aed6/0xb7cb3d7479d60a75 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.643256:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1789081800.643260:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081800.643267:0:14756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fac1aed6/0xb7cb3d7479d60a75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.643281:0:14756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fac1aed6/0xb7cb3d7479d60a75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.643289:0:14756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fac1aed6/0xb7cb3d7479d60a75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.643297:0:14756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fac1aed6/0xb7cb3d7479d60a75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.643320:0:14756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789081800.643335:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789081800.643340:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fac1aed6/0xb7cb3d7479d60a75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.643348:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998e00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:3.0:1789081800.643352:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fac1aed6/0xb7cb3d7479d60a75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.643361:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fac1aed6/0xb7cb3d7479d60a75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.643389:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fac1aed6/0xb7cb3d7479d60a75 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.643397:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fac1aed6/0xb7cb3d7479d60a75 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.643414:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081800.643415:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081800.643417:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789081800.644470:0:14756:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789081800.644480:0:14756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009dc56b41/0xb7cb3d7479d60a7c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.644490:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1789081800.644494:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081800.644499:0:14756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009dc56b41/0xb7cb3d7479d60a7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.644509:0:14756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009dc56b41/0xb7cb3d7479d60a7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.644518:0:14756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009dc56b41/0xb7cb3d7479d60a7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.644557:0:14756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009dc56b41/0xb7cb3d7479d60a7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.644587:0:14756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789081800.645061:0:14756:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789081800.645067:0:14756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7aa690f/0xb7cb3d7479d60a83 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.645076:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1789081800.645079:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081800.645084:0:14756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7aa690f/0xb7cb3d7479d60a83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.645093:0:14756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7aa690f/0xb7cb3d7479d60a83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.645100:0:14756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7aa690f/0xb7cb3d7479d60a83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.645107:0:14756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7aa690f/0xb7cb3d7479d60a83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.645124:0:14756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789081800.645137:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789081800.645142:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009dc56b41/0xb7cb3d7479d60a7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.645150:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998800 already unused, calling callback (ffffffffc1784220) 00010000:00010000:3.0:1789081800.645161:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009dc56b41/0xb7cb3d7479d60a7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.645171:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009dc56b41/0xb7cb3d7479d60a7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.645186:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009dc56b41/0xb7cb3d7479d60a7c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.645193:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009dc56b41/0xb7cb3d7479d60a7c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.645208:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789081800.645211:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7aa690f/0xb7cb3d7479d60a83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.645218:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998a00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:3.0:1789081800.645221:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7aa690f/0xb7cb3d7479d60a83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.645228:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7aa690f/0xb7cb3d7479d60a83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.645236:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7aa690f/0xb7cb3d7479d60a83 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.645243:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7aa690f/0xb7cb3d7479d60a83 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.645258:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081800.645259:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081800.645261:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081800.645748:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789081800.646283:0:14756:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789081800.646292:0:14756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a08dbed5/0xb7cb3d7479d60a8a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.646305:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1789081800.646309:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081800.646314:0:14756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a08dbed5/0xb7cb3d7479d60a8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.646324:0:14756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a08dbed5/0xb7cb3d7479d60a8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.646332:0:14756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a08dbed5/0xb7cb3d7479d60a8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.646338:0:14756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a08dbed5/0xb7cb3d7479d60a8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.646364:0:14756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789081800.647504:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789081800.647515:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a08dbed5/0xb7cb3d7479d60a8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.647548:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998c00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:2.0:1789081800.647553:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a08dbed5/0xb7cb3d7479d60a8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.647562:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a08dbed5/0xb7cb3d7479d60a8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.647580:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a08dbed5/0xb7cb3d7479d60a8a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.647602:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a08dbed5/0xb7cb3d7479d60a8a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.647633:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081800.647636:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081800.647637:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789081800.648151:0:14756:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789081800.648158:0:14756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e192ea07/0xb7cb3d7479d60a91 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.648181:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1789081800.648185:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081800.648191:0:14756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e192ea07/0xb7cb3d7479d60a91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.648203:0:14756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e192ea07/0xb7cb3d7479d60a91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.648210:0:14756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e192ea07/0xb7cb3d7479d60a91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.648217:0:14756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e192ea07/0xb7cb3d7479d60a91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.648325:0:14756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789081800.648863:0:14756:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789081800.648870:0:14756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae3bce25/0xb7cb3d7479d60a98 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.648880:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1789081800.648884:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081800.648889:0:14756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae3bce25/0xb7cb3d7479d60a98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.648899:0:14756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae3bce25/0xb7cb3d7479d60a98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.648921:0:14756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae3bce25/0xb7cb3d7479d60a98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.648928:0:14756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae3bce25/0xb7cb3d7479d60a98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789081800.649018:0:5811:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:1.0:1789081800.649331:0:14109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789081800.649339:0:14109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e192ea07/0xb7cb3d7479d60a91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081800.649347:0:14109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999a00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:1.0:1789081800.649351:0:14109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e192ea07/0xb7cb3d7479d60a91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081800.649361:0:14109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e192ea07/0xb7cb3d7479d60a91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081800.649379:0:14109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e192ea07/0xb7cb3d7479d60a91 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081800.649386:0:14109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e192ea07/0xb7cb3d7479d60a91 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081800.649416:0:14109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789081800.649420:0:14109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae3bce25/0xb7cb3d7479d60a98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081800.649427:0:14109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999800 already unused, calling callback (ffffffffc1784220) 00010000:00010000:1.0:1789081800.649430:0:14109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae3bce25/0xb7cb3d7479d60a98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081800.649437:0:14109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae3bce25/0xb7cb3d7479d60a98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081800.649448:0:14109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae3bce25/0xb7cb3d7479d60a98 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081800.649455:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081800.649457:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081800.649458:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081800.649499:0:14756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789081800.649505:0:14756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae3bce25/0xb7cb3d7479d60a98 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081800.649716:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789081800.650166:0:14756:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789081800.650173:0:14756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063063d14/0xb7cb3d7479d60a9f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.650183:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1789081800.650187:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081800.650194:0:14756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063063d14/0xb7cb3d7479d60a9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.650206:0:14756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063063d14/0xb7cb3d7479d60a9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.650215:0:14756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063063d14/0xb7cb3d7479d60a9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.650233:0:14756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000063063d14/0xb7cb3d7479d60a9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.650299:0:14756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789081800.650837:0:14756:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789081800.650843:0:14756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001cb618a/0xb7cb3d7479d60aa6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.650852:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1789081800.650856:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081800.650861:0:14756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001cb618a/0xb7cb3d7479d60aa6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.650870:0:14756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001cb618a/0xb7cb3d7479d60aa6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.650878:0:14756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001cb618a/0xb7cb3d7479d60aa6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.650884:0:14756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001cb618a/0xb7cb3d7479d60aa6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081800.651430:0:14109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789081800.651439:0:14109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000063063d14/0xb7cb3d7479d60a9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081800.651448:0:14109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998200 already unused, calling callback (ffffffffc1784220) 00010000:00010000:1.0:1789081800.651452:0:14109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000063063d14/0xb7cb3d7479d60a9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081800.651475:0:14109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000063063d14/0xb7cb3d7479d60a9f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081800.651491:0:14109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000063063d14/0xb7cb3d7479d60a9f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081800.651500:0:14109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063063d14/0xb7cb3d7479d60a9f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081800.651548:0:14109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789081800.651552:0:14109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001cb618a/0xb7cb3d7479d60aa6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081800.651559:0:14109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999000 already unused, calling callback (ffffffffc1784220) 00010000:00010000:1.0:1789081800.651561:0:14109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001cb618a/0xb7cb3d7479d60aa6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081800.651568:0:14109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001cb618a/0xb7cb3d7479d60aa6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081800.651576:0:14109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001cb618a/0xb7cb3d7479d60aa6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081800.651584:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081800.651586:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081800.651593:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081800.651777:0:14756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789081800.651783:0:14756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001cb618a/0xb7cb3d7479d60aa6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789081800.652322:0:14756:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789081800.652329:0:14756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009944c9fc/0xb7cb3d7479d60aad lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.652339:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1789081800.652343:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081800.652349:0:14756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009944c9fc/0xb7cb3d7479d60aad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.652360:0:14756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009944c9fc/0xb7cb3d7479d60aad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.652368:0:14756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009944c9fc/0xb7cb3d7479d60aad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.652376:0:14756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009944c9fc/0xb7cb3d7479d60aad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.652466:0:14756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789081800.652906:0:14756:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789081800.652912:0:14756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000819e4087/0xb7cb3d7479d60ab4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.652921:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1789081800.652925:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081800.652935:0:14756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000819e4087/0xb7cb3d7479d60ab4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.652945:0:14756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000819e4087/0xb7cb3d7479d60ab4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.652953:0:14756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000819e4087/0xb7cb3d7479d60ab4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.652960:0:14756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000819e4087/0xb7cb3d7479d60ab4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.653070:0:14109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789081800.653077:0:14109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009944c9fc/0xb7cb3d7479d60aad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.653086:0:14109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999e00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:2.0:1789081800.653090:0:14109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009944c9fc/0xb7cb3d7479d60aad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.653099:0:14109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009944c9fc/0xb7cb3d7479d60aad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.653113:0:14109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009944c9fc/0xb7cb3d7479d60aad lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.653120:0:14109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009944c9fc/0xb7cb3d7479d60aad lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.653138:0:14109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789081800.653142:0:14109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000819e4087/0xb7cb3d7479d60ab4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.653155:0:14109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998000 already unused, calling callback (ffffffffc1784220) 00010000:00010000:2.0:1789081800.653159:0:14109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000819e4087/0xb7cb3d7479d60ab4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.653167:0:14109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000819e4087/0xb7cb3d7479d60ab4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.653177:0:14109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000819e4087/0xb7cb3d7479d60ab4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081800.653185:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081800.653187:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789081800.653189:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081800.656220:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081800.662903:0:14756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789081800.662920:0:14756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000819e4087/0xb7cb3d7479d60ab4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789081800.663766:0:14756:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789081800.663775:0:14756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cda65dca/0xb7cb3d7479d60abb lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.663789:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1789081800.663794:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081800.663801:0:14756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cda65dca/0xb7cb3d7479d60abb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.663814:0:14756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cda65dca/0xb7cb3d7479d60abb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.663848:0:14756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cda65dca/0xb7cb3d7479d60abb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.663855:0:14756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cda65dca/0xb7cb3d7479d60abb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.663879:0:14756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789081800.664291:0:14756:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789081800.664297:0:14756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e40a19c/0xb7cb3d7479d60ac2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.664306:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1789081800.664310:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081800.664315:0:14756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e40a19c/0xb7cb3d7479d60ac2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.664323:0:14756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e40a19c/0xb7cb3d7479d60ac2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.664331:0:14756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e40a19c/0xb7cb3d7479d60ac2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.664338:0:14756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e40a19c/0xb7cb3d7479d60ac2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.664358:0:14756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789081800.664634:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789081800.664643:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cda65dca/0xb7cb3d7479d60abb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081800.664652:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999c00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:0.0:1789081800.664657:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cda65dca/0xb7cb3d7479d60abb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081800.664666:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cda65dca/0xb7cb3d7479d60abb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081800.664688:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cda65dca/0xb7cb3d7479d60abb lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081800.664698:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cda65dca/0xb7cb3d7479d60abb lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081800.664719:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789081800.664723:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e40a19c/0xb7cb3d7479d60ac2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081800.664729:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10c29e0e00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:0.0:1789081800.664732:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e40a19c/0xb7cb3d7479d60ac2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081800.664748:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e40a19c/0xb7cb3d7479d60ac2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081800.664759:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e40a19c/0xb7cb3d7479d60ac2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081800.664766:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e40a19c/0xb7cb3d7479d60ac2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081800.664780:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081800.664782:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789081800.664784:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081800.669744:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789081800.669976:0:14756:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789081800.669989:0:14756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b652ed58/0xb7cb3d7479d60ac9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.670008:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1789081800.670013:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081800.670021:0:14756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b652ed58/0xb7cb3d7479d60ac9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.670036:0:14756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b652ed58/0xb7cb3d7479d60ac9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.670047:0:14756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b652ed58/0xb7cb3d7479d60ac9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.670055:0:14756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b652ed58/0xb7cb3d7479d60ac9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.670117:0:14756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789081800.671829:0:14756:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789081800.671841:0:14756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cfa7d43/0xb7cb3d7479d60ad0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.671856:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1789081800.671870:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081800.671877:0:14756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cfa7d43/0xb7cb3d7479d60ad0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.671890:0:14756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009cfa7d43/0xb7cb3d7479d60ad0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.671899:0:14756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cfa7d43/0xb7cb3d7479d60ad0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081800.671907:0:14756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009cfa7d43/0xb7cb3d7479d60ad0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081800.672381:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789081800.672391:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b652ed58/0xb7cb3d7479d60ac9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081800.672401:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10c29e1a00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:1.0:1789081800.672407:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b652ed58/0xb7cb3d7479d60ac9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081800.672416:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b652ed58/0xb7cb3d7479d60ac9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081800.672435:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b652ed58/0xb7cb3d7479d60ac9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081800.672444:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b652ed58/0xb7cb3d7479d60ac9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081800.672468:0:14110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789081800.672471:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009cfa7d43/0xb7cb3d7479d60ad0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081800.672478:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10c29e1200 already unused, calling callback (ffffffffc1784220) 00010000:00010000:1.0:1789081800.672481:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009cfa7d43/0xb7cb3d7479d60ad0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081800.672504:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009cfa7d43/0xb7cb3d7479d60ad0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081800.672514:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009cfa7d43/0xb7cb3d7479d60ad0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081800.672536:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081800.672539:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081800.672541:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789081800.672719:0:14756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789081800.672725:0:14756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009cfa7d43/0xb7cb3d7479d60ad0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1789081800.673046:0:14756:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:3.0:1789081800.673175:0:14756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14146:x1875987821331840:12345-0@lo:5:osp-pre-1-0.0 Request processed in 126254us (127097us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081800.673187:0:14756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789081800.673247:0:14146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c02d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14146:1875987821331840:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789081800.673263:0:14146:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:3.0:1789081800.673309:0:14146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c02d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14146:1875987821331968:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789081800.673341:0:14146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081800.673398:0:14146:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c7c55b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789081800.673424:0:14756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821331968 00000100:00100000:3.0:1789081800.673430:0:14756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821331968 00000100:00100000:3.0:1789081800.673478:0:14756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789081800.673487:0:14756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14146:x1875987821331968:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1789081800.673571:0:14756:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:1.0:1789081800.675351:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081800.680469:0:14756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14146:x1875987821331968:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6976us (7119us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789081800.680483:0:14756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789081800.680585:0:14146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c02d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14146:1875987821331968:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789081800.680603:0:14146:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000040:00080000:2.0:1789081801.054221:0:14155:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789081801.629155:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081802.654090:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789081802.832480:0:15779:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg117-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789081803.678013:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081804.639214:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821332096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789081804.639280:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081804.640139:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821332096 00000100:00100000:1.0:1789081804.640149:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821332096 00000100:00100000:1.0:1789081804.642565:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789081804.642589:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821332096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789081804.642628:0:14761:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789081804.642717:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821332096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (3435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081804.642724:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789081804.642942:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821332096:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789081804.643055:0:14117:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789081804.701912:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789081805.021857:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081805.021974:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796174080 00000100:00100000:1.0:1789081805.021986:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796174080 00000100:00100000:1.0:1789081805.022039:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 75 00000100:00100000:1.0:1789081805.022048:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2347:x1875987796174080:12345-192.168.201.17@tcp:250:mount.lustre.0 00010000:00080000:1.0:1789081805.022094:0:14114:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 9a67ef68-2159-4a6b-960e-9de3ab596c83@192.168.201.17@tcp t0 exp 0000000000000000 cur 471 last 0 00000020:00000080:1.0:1789081805.022123:0:14114:0:(genops.c:1406:class_connect()) connect: client 9a67ef68-2159-4a6b-960e-9de3ab596c83, cookie 0xb7cb3d7479d60ad7 00000100:00080000:1.0:1789081805.022269:0:14114:0:(import.c:65:import_set_state_nolock()) ffff9e0fc21d6000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789081805.022352:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a67ef68-2159-4a6b-960e-9de3ab596c83+5:2347:x1875987796174080:12345-192.168.201.17@tcp:250:mount.lustre.0 Request processed in 303us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081805.022370:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 75 00000100:00100000:1.0:1789081805.034993:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081805.035153:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796174208 00000100:00100000:2.0:1789081805.035165:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796174208 00000100:00100000:2.0:1789081805.035229:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 76 00000100:00100000:2.0:1789081805.035240:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a67ef68-2159-4a6b-960e-9de3ab596c83+5:13705:x1875987796174208:12345-192.168.201.17@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789081805.035259:0:14115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081805.035279:0:14115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e1101775c00/0xb7cb3d7479d60ade lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ac16 expref: -99 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081805.035312:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e1101775c00/0xb7cb3d7479d60ade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ac16 expref: 6 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081805.035339:0:14115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e1101775c00/0xb7cb3d7479d60ade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ac16 expref: 6 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081805.035350:0:14115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101775c00, rc 0) 00000100:00100000:2.0:1789081805.035433:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a67ef68-2159-4a6b-960e-9de3ab596c83+6:13705:x1875987796174208:12345-192.168.201.17@tcp:101:mount.lustre.0 Request processed in 194us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081805.035440:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 76 00000100:00100000:0.0:1789081805.041350:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081805.041456:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796174336 00000100:00100000:3.0:1789081805.041468:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796174336 00000100:00100000:3.0:1789081805.041563:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 77 00000100:00100000:3.0:1789081805.041574:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a67ef68-2159-4a6b-960e-9de3ab596c83+6:13705:x1875987796174336:12345-192.168.201.17@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789081805.041956:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a67ef68-2159-4a6b-960e-9de3ab596c83+6:13705:x1875987796174336:12345-192.168.201.17@tcp:501:mount.lustre.0 Request processed in 382us (615us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789081805.041965:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 77 00000100:00100000:0.0:1789081805.051482:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081805.051639:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796174464 00000100:00100000:1.0:1789081805.051650:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796174464 00000100:00100000:1.0:1789081805.051709:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 78 00000100:00100000:1.0:1789081805.051719:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a67ef68-2159-4a6b-960e-9de3ab596c83+6:13705:x1875987796174464:12345-192.168.201.17@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789081805.051736:0:14114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081805.051766:0:14114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10e13af800/0xb7cb3d7479d60ae5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ac1d expref: -99 pid: 14114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081805.051797:0:14114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10e13af800/0xb7cb3d7479d60ae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ac1d expref: 7 pid: 14114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081805.051809:0:14114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10e13af800/0xb7cb3d7479d60ae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ac1d expref: 7 pid: 14114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081805.051819:0:14114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13af800, rc 0) 00000100:00100000:1.0:1789081805.051928:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a67ef68-2159-4a6b-960e-9de3ab596c83+7:13705:x1875987796174464:12345-192.168.201.17@tcp:101:mount.lustre.0 Request processed in 210us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081805.051935:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 78 00000100:00100000:1.0:1789081805.062054:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081805.062157:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796174592 00000100:00100000:2.0:1789081805.062168:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796174592 00000100:00100000:2.0:1789081805.062227:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 79 00000100:00100000:2.0:1789081805.062237:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a67ef68-2159-4a6b-960e-9de3ab596c83+7:13705:x1875987796174592:12345-192.168.201.17@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789081805.062595:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a67ef68-2159-4a6b-960e-9de3ab596c83+8:13705:x1875987796174592:12345-192.168.201.17@tcp:501:mount.lustre.0 Request processed in 358us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081805.062604:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 79 00000100:00100000:0.0:1789081805.068398:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081805.068485:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796174720 00000100:00100000:3.0:1789081805.068494:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796174720 00000100:00100000:3.0:1789081805.068598:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 80 00000100:00100000:3.0:1789081805.068610:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a67ef68-2159-4a6b-960e-9de3ab596c83+8:13705:x1875987796174720:12345-192.168.201.17@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789081805.069038:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a67ef68-2159-4a6b-960e-9de3ab596c83+8:13705:x1875987796174720:12345-192.168.201.17@tcp:503:mount.lustre.0 Request processed in 429us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081805.069054:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 80 00000100:00100000:0.0:1789081805.074450:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081805.074568:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796174848 00000100:00100000:1.0:1789081805.074595:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796174848 00000100:00100000:1.0:1789081805.074656:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 81 00000100:00100000:1.0:1789081805.074666:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a67ef68-2159-4a6b-960e-9de3ab596c83+8:13723:x1875987796174848:12345-192.168.201.17@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789081805.075025:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a67ef68-2159-4a6b-960e-9de3ab596c83+8:13723:x1875987796174848:12345-192.168.201.17@tcp:502:llog_process_th.0 Request processed in 359us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081805.075034:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 81 00000100:00100000:1.0:1789081805.107466:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081805.107583:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796174976 00000100:00100000:2.0:1789081805.107596:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796174976 00000100:00100000:2.0:1789081805.107657:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 82 00000100:00100000:2.0:1789081805.107667:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a67ef68-2159-4a6b-960e-9de3ab596c83+8:13723:x1875987796174976:12345-192.168.201.17@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789081805.107974:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a67ef68-2159-4a6b-960e-9de3ab596c83+8:13723:x1875987796174976:12345-192.168.201.17@tcp:502:llog_process_th.0 Request processed in 308us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081805.107983:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 82 00000100:00100000:0.0:1789081805.116299:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081805.116403:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796175104 00000100:00100000:3.0:1789081805.116415:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796175104 00000100:00100000:3.0:1789081805.116474:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 83 00000100:00100000:3.0:1789081805.116485:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a67ef68-2159-4a6b-960e-9de3ab596c83+8:13705:x1875987796175104:12345-192.168.201.17@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789081805.116504:0:14116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081805.116567:0:14116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10c29e1200/0xb7cb3d7479d60aec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ac47 expref: -99 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081805.116600:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10c29e1200/0xb7cb3d7479d60aec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ac47 expref: 9 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081805.116611:0:14116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10c29e1200/0xb7cb3d7479d60aec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ac47 expref: 9 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081805.116620:0:14116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10c29e1200, rc 0) 00000100:00100000:3.0:1789081805.116680:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a67ef68-2159-4a6b-960e-9de3ab596c83+9:13705:x1875987796175104:12345-192.168.201.17@tcp:101:mount.lustre.0 Request processed in 196us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081805.116687:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 83 00000100:00100000:0.0:1789081805.148070:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081805.148351:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796175232 00000100:00100000:1.0:1789081805.148364:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796175232 00000100:00100000:1.0:1789081805.148426:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 84 00000100:00100000:1.0:1789081805.148438:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a67ef68-2159-4a6b-960e-9de3ab596c83+9:13705:x1875987796175232:12345-192.168.201.17@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789081805.148466:0:14114:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789081805.148491:0:14114:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789081805.148496:0:14114:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789081805.148499:0:14114:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789081805.148502:0:14114:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1789081805.151828:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a67ef68-2159-4a6b-960e-9de3ab596c83+9:13705:x1875987796175232:12345-192.168.201.17@tcp:256:mount.lustre.0 Request processed in 3381us (3756us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081805.151842:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 84 00000100:00100000:0.0:1789081805.155334:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081805.155579:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796175360 00000100:00100000:2.0:1789081805.155590:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796175360 00000100:00100000:2.0:1789081805.155652:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 85 00000100:00100000:2.0:1789081805.155663:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a67ef68-2159-4a6b-960e-9de3ab596c83+9:13705:x1875987796175360:12345-192.168.201.17@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789081805.155680:0:14115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081805.155697:0:14115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e1101774400/0xb7cb3d7479d60af3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ac4e expref: -99 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081805.155726:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e1101774400/0xb7cb3d7479d60af3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ac4e expref: 10 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081805.155749:0:14115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e1101774400/0xb7cb3d7479d60af3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ac4e expref: 10 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081805.155758:0:14115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101774400, rc 0) 00000100:00100000:2.0:1789081805.155822:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a67ef68-2159-4a6b-960e-9de3ab596c83+10:13705:x1875987796175360:12345-192.168.201.17@tcp:101:mount.lustre.0 Request processed in 159us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081805.155834:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 85 00000100:00100000:0.0:1789081805.158129:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081805.158232:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796175488 00000100:00100000:2.0:1789081805.158241:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796175488 00000100:00100000:2.0:1789081805.158293:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 86 00000100:00100000:2.0:1789081805.158302:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a67ef68-2159-4a6b-960e-9de3ab596c83+10:13705:x1875987796175488:12345-192.168.201.17@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789081805.158675:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a67ef68-2159-4a6b-960e-9de3ab596c83+10:13705:x1875987796175488:12345-192.168.201.17@tcp:501:mount.lustre.0 Request processed in 373us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081805.158683:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 86 00000100:00100000:1.0:1789081805.168427:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081805.168675:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796175616 00000100:00100000:2.0:1789081805.168685:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796175616 00000100:00100000:2.0:1789081805.168757:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 87 00000100:00100000:2.0:1789081805.168783:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a67ef68-2159-4a6b-960e-9de3ab596c83+10:13705:x1875987796175616:12345-192.168.201.17@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789081805.169097:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a67ef68-2159-4a6b-960e-9de3ab596c83+10:13705:x1875987796175616:12345-192.168.201.17@tcp:503:mount.lustre.0 Request processed in 315us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081805.169105:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 87 00000100:00100000:0.0:1789081805.173920:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081805.174150:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796175744 00000100:00100000:3.0:1789081805.174160:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796175744 00000100:00100000:3.0:1789081805.174218:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 88 00000100:00100000:3.0:1789081805.174238:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a67ef68-2159-4a6b-960e-9de3ab596c83+10:13725:x1875987796175744:12345-192.168.201.17@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789081805.174584:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a67ef68-2159-4a6b-960e-9de3ab596c83+10:13725:x1875987796175744:12345-192.168.201.17@tcp:502:llog_process_th.0 Request processed in 346us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081805.174592:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 88 00000100:00100000:0.0:1789081805.187913:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081805.188204:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796175872 00000100:00100000:1.0:1789081805.188215:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796175872 00000100:00100000:1.0:1789081805.188276:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 89 00000100:00100000:1.0:1789081805.188286:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a67ef68-2159-4a6b-960e-9de3ab596c83+10:13725:x1875987796175872:12345-192.168.201.17@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789081805.188775:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a67ef68-2159-4a6b-960e-9de3ab596c83+10:13725:x1875987796175872:12345-192.168.201.17@tcp:502:llog_process_th.0 Request processed in 488us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081805.188783:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 89 00000100:00100000:1.0:1789081805.203710:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081805.207504:0:15260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796176000 00000100:00100000:3.0:1789081805.207520:0:15260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796176000 00000100:00100000:3.0:1789081805.207630:0:15260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 4 00000100:00100000:3.0:1789081805.207638:0:15260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10fada4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2347:x1875987796176000:12345-192.168.201.17@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789081805.207671:0:15260:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from ed84e792-638e-46e0-85a3-6e17c331902b@192.168.201.17@tcp t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:3.0:1789081805.207731:0:15260:0:(genops.c:1406:class_connect()) connect: client ed84e792-638e-46e0-85a3-6e17c331902b, cookie 0xb7cb3d7479d60afa 00000004:00100000:3.0:1789081805.207776:0:15260:0:(mdt_handler.c:7402:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1789081805.207783:0:15260:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1789081805.259292:0:15260:0:(import.c:65:import_set_state_nolock()) ffff9e0fc21a8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789081805.259466:0:15260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10fada4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed84e792-638e-46e0-85a3-6e17c331902b+6:2347:x1875987796176000:12345-192.168.201.17@tcp:38:mount.lustre.0 Request processed in 51826us (55763us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081805.259478:0:15260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 4 00000100:00100000:0.0:1789081805.262643:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081805.262692:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081805.262802:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796176128 00000100:00100000:1.0:1789081805.262817:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796176128 00000100:00100000:1.0:1789081805.262887:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796176256 00000100:00100000:1.0:1789081805.262891:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796176256 00000100:00100000:1.0:1789081805.262912:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 5 00000100:00100000:1.0:1789081805.262921:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed84e792-638e-46e0-85a3-6e17c331902b+7:0:x1875987796176128:12345-192.168.201.17@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789081805.262966:0:14121:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789081805.263048:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed84e792-638e-46e0-85a3-6e17c331902b+7:0:x1875987796176128:12345-192.168.201.17@tcp:41:mount.lustre.0 Request processed in 127us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081805.263055:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 5 00000100:00100000:1.0:1789081805.263072:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 6 00000100:00100000:1.0:1789081805.263079:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed84e792-638e-46e0-85a3-6e17c331902b+6:13705:x1875987796176256:12345-192.168.201.17@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789081805.263092:0:14121:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789081805.263115:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed84e792-638e-46e0-85a3-6e17c331902b+6:13705:x1875987796176256:12345-192.168.201.17@tcp:41:mount.lustre.0 Request processed in 36us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081805.263121:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 6 00000100:00080000:3.0:1789081805.263309:0:14117:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789081805.266259:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081805.266470:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796176384 00000100:00100000:1.0:1789081805.266481:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796176384 00000100:00100000:1.0:1789081805.266583:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 7 00000100:00100000:1.0:1789081805.266593:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed84e792-638e-46e0-85a3-6e17c331902b+6:13705:x1875987796176384:12345-192.168.201.17@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789081805.266675:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed84e792-638e-46e0-85a3-6e17c331902b+6:13705:x1875987796176384:12345-192.168.201.17@tcp:40:mount.lustre.0 Request processed in 83us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081805.266683:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 7 00000100:00100000:1.0:1789081805.269942:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081805.269986:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081805.270066:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081805.270138:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796176768 00000100:00100000:2.0:1789081805.270149:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796176768 00000100:00100000:2.0:1789081805.270209:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 0 00000100:00100000:2.0:1789081805.270218:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10fada7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed84e792-638e-46e0-85a3-6e17c331902b+6:13705:x1875987796176768:12345-192.168.201.17@tcp:33:mount.lustre.0 00000004:00080000:0.0:1789081805.274971:0:14124:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4670us 00000100:00100000:3.0:1789081805.277001:0:14758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796176512 00000100:00100000:3.0:1789081805.277015:0:14758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796176512 00000100:00100000:2.0:1789081805.277104:0:14758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796176640 00000100:00100000:2.0:1789081805.277110:0:14758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796176640 00000100:00100000:0.0:1789081805.277125:0:14759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 7 00000100:00100000:0.0:1789081805.277139:0:14759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10fada4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2347:x1875987796176512:12345-192.168.201.17@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789081805.277172:0:14759:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from ed84e792-638e-46e0-85a3-6e17c331902b@192.168.201.17@tcp t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:0.0:1789081805.277208:0:14759:0:(genops.c:1406:class_connect()) connect: client ed84e792-638e-46e0-85a3-6e17c331902b, cookie 0xb7cb3d7479d60b01 00002000:00100000:0.0:1789081805.277220:0:14759:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ed84e792-638e-46e0-85a3-6e17c331902b/ffff9e0fc2da1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113719 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789081805.277231:0:14759:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789081805.277790:0:14759:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789081805.277840:0:14759:0:(import.c:65:import_set_state_nolock()) ffff9e0fc2da2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789081805.277936:0:14759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10fada4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed84e792-638e-46e0-85a3-6e17c331902b+6:2347:x1875987796176512:12345-192.168.201.17@tcp:8:mount.lustre.0 Request processed in 796us (7949us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081805.282165:0:14759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 7 00000100:00100000:0.0:1789081805.282205:0:14759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 8 00000100:00100000:0.0:1789081805.282215:0:14759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10fada5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2347:x1875987796176640:12345-192.168.201.17@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789081805.282248:0:14759:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from ed84e792-638e-46e0-85a3-6e17c331902b@192.168.201.17@tcp t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:0.0:1789081805.284439:0:14759:0:(genops.c:1406:class_connect()) connect: client ed84e792-638e-46e0-85a3-6e17c331902b, cookie 0xb7cb3d7479d60b08 00002000:00100000:0.0:1789081805.284461:0:14759:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ed84e792-638e-46e0-85a3-6e17c331902b/ffff9e0fc2da6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113719 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789081805.284498:0:14759:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789081805.284710:0:14759:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789081805.284762:0:14759:0:(import.c:65:import_set_state_nolock()) ffff9e0fc2da4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789081805.285046:0:14759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10fada5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed84e792-638e-46e0-85a3-6e17c331902b+6:2347:x1875987796176640:12345-192.168.201.17@tcp:8:mount.lustre.0 Request processed in 2830us (14977us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081805.285058:0:14759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 8 00000004:00200000:0.0:1789081805.289894:0:14124:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1789081805.290123:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10fada7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed84e792-638e-46e0-85a3-6e17c331902b+6:13705:x1875987796176768:12345-192.168.201.17@tcp:33:mount.lustre.0 Request processed in 19900us (20184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081805.290138:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 0 00000100:00100000:1.0:1789081805.496148:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081805.496281:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796176896 00000100:00100000:0.0:1789081805.496292:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796176896 00000100:00100000:0.0:1789081805.496410:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 8 00000100:00100000:0.0:1789081805.496422:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10fada6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed84e792-638e-46e0-85a3-6e17c331902b+6:13746:x1875987796176896:12345-192.168.201.17@tcp:101:mkdir.0 00010000:00010000:0.0:1789081805.496444:0:14122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081805.496488:0:14122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60b0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ac78 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081805.496581:0:14122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d60b16 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081805.496594:0:14122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d60b16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081805.496608:0:14122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d60b16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789081805.496917:0:14122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789081805.496921:0:14122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1789081805.497009:0:14122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d60b16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081805.497040:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60b0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ac78 expref: 8 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081805.497056:0:14122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d60b16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ac78 expref: 7 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081805.497070:0:14122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c52f5000) 00010000:00010000:0.0:1789081805.497072:0:14122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789081805.497075:0:14122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101983000, rc 0) 00000100:00100000:0.0:1789081805.497147:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10fada6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed84e792-638e-46e0-85a3-6e17c331902b+7:13746:x1875987796176896:12345-192.168.201.17@tcp:101:mkdir.0 Request processed in 727us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081805.497154:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 8 00000100:00100000:0.0:1789081805.660864:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821332352:0@lo:400:kworker.0 00000100:00100000:0.0:1789081805.660933:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081805.660995:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875987821332864:0@lo:400:kworker.0 00000100:00100000:0.0:1789081805.661020:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081805.661042:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789081805.661047:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821332480:0@lo:400:kworker.0 00000100:00100000:0.0:1789081805.661065:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081805.661205:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:3304:1875987821332224:0@lo:400:kworker.0 00000100:00100000:3.0:1789081805.661236:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081805.661264:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875987821332736:0@lo:400:kworker.0 00000100:00100000:3.0:1789081805.661283:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081805.661299:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789081805.661303:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875987821332608:0@lo:400:kworker.0 00000100:00100000:3.0:1789081805.661319:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081805.661341:0:15260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821332864 00000100:00100000:3.0:1789081805.661347:0:15260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821332864 00000100:00100000:3.0:1789081805.661388:0:15260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821332736 00000100:00100000:3.0:1789081805.661391:0:15260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821332736 00000100:00100000:3.0:1789081805.661401:0:15260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821332608 00000100:00100000:3.0:1789081805.661414:0:15260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821332608 00000100:00100000:3.0:1789081805.661430:0:15260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789081805.661438:0:15260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875987821332864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081805.661493:0:15260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875987821332864:12345-0@lo:400:kworker.0 Request processed in 44us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081805.661501:0:15260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789081805.661517:0:15260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789081805.661545:0:15260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875987821332736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081805.661578:0:15260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875987821332736:12345-0@lo:400:kworker.0 Request processed in 55us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081805.661585:0:15260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789081805.661597:0:15260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789081805.661603:0:15260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875987821332608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081805.661626:0:15260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875987821332608:12345-0@lo:400:kworker.0 Request processed in 25us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081805.661632:0:15260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1789081805.661645:0:14117:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789081805.661675:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875987821332608:0@lo:400:kworker.0 00000100:00100000:3.0:1789081805.661685:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875987821332736:0@lo:400:kworker.0 00000100:00100000:1.0:1789081805.661783:0:14756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821332352 00000100:00100000:1.0:1789081805.661787:0:14756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821332352 00000100:00100000:1.0:1789081805.661825:0:14756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821332480 00000100:00100000:1.0:1789081805.661828:0:14756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821332480 00000100:00100000:1.0:1789081805.661851:0:14756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789081805.661857:0:14756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821332352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081805.661889:0:14756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821332352:12345-0@lo:400:kworker.0 Request processed in 32us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081805.661894:0:14756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789081805.661905:0:14756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789081805.661910:0:14756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1875987821332480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081805.661930:0:14756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1875987821332480:12345-0@lo:400:kworker.0 Request processed in 19us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081805.661935:0:14756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789081805.661946:0:14117:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789081805.663089:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821332992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789081805.663142:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081805.663239:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821332224 00000100:00100000:0.0:1789081805.663245:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821332224 00000100:00100000:0.0:1789081805.663286:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789081805.663293:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+19:3304:x1875987821332224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081805.663343:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+19:3304:x1875987821332224:12345-0@lo:400:kworker.0 Request processed in 50us (2105us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081805.663350:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789081805.664045:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821332480:0@lo:400:kworker.0 00000100:00100000:0.0:1789081805.664062:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821332352:0@lo:400:kworker.0 00000100:00100000:0.0:1789081805.664077:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875987821332864:0@lo:400:kworker.0 00000100:00100000:2.0:1789081805.669268:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:3304:1875987821332224:0@lo:400:kworker.0 00000100:00100000:3.0:1789081805.670674:0:14760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821332992 00000100:00100000:3.0:1789081805.670689:0:14760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821332992 00000100:00100000:3.0:1789081805.670764:0:14760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789081805.670775:0:14760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875987821332992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789081805.670814:0:14760:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789081805.670918:0:14760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875987821332992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 144us (7774us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081805.670935:0:14760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789081805.673984:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821332992:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789081805.725323:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789081805.728167:0:7493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ed84e792-638e-46e0-85a3-6e17c331902b 00000001:00080000:0.0:1789081805.728203:0:7493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1789081805.728230:0:7493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789081806.740845:0:6607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ed84e792-638e-46e0-85a3-6e17c331902b 00010000:00010000:1.0:1789081806.748868:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789081807.419879:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081807.420016:0:15260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796177024 00000100:00100000:3.0:1789081807.420028:0:15260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796177024 00000100:00100000:3.0:1789081807.420124:0:15260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 9 00000100:00100000:3.0:1789081807.420136:0:15260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed84e792-638e-46e0-85a3-6e17c331902b+7:13798:x1875987796177024:12345-192.168.201.17@tcp:41:lfs.0 00000004:00000024:3.0:1789081807.420179:0:15260:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789081807.420256:0:15260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed84e792-638e-46e0-85a3-6e17c331902b+7:13798:x1875987796177024:12345-192.168.201.17@tcp:41:lfs.0 Request processed in 123us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081807.420264:0:15260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 9 00000100:00080000:1.0:1789081807.420443:0:14117:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789081807.423513:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081807.423643:0:14760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796177152 00000100:00100000:2.0:1789081807.423653:0:14760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796177152 00000100:00100000:2.0:1789081807.423738:0:14760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 5 00000100:00100000:2.0:1789081807.423749:0:14760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ed84e792-638e-46e0-85a3-6e17c331902b+5:13798:x1875987796177152:12345-192.168.201.17@tcp:13:lfs.0 00002000:00000024:2.0:1789081807.423795:0:14760:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789081807.424143:0:14760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ed84e792-638e-46e0-85a3-6e17c331902b+5:13798:x1875987796177152:12345-192.168.201.17@tcp:13:lfs.0 Request processed in 393us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081807.424152:0:14760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 5 00000100:00080000:1.0:1789081807.426057:0:14117:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789081807.438863:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081807.439062:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796177280 00000100:00100000:3.0:1789081807.439072:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796177280 00000100:00100000:3.0:1789081807.439154:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 6 00000100:00100000:3.0:1789081807.439167:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10fada5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ed84e792-638e-46e0-85a3-6e17c331902b+5:13798:x1875987796177280:12345-192.168.201.17@tcp:13:lfs.0 00002000:00000024:3.0:1789081807.439208:0:14761:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789081807.439297:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10fada5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ed84e792-638e-46e0-85a3-6e17c331902b+5:13798:x1875987796177280:12345-192.168.201.17@tcp:13:lfs.0 Request processed in 132us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081807.439305:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 6 00000100:00080000:1.0:1789081807.439431:0:14117:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789081807.645242:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081807.645385:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796177408 00000100:00100000:1.0:1789081807.645394:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796177408 00000100:00100000:1.0:1789081807.645446:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 91 00000100:00100000:1.0:1789081807.645454:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a67ef68-2159-4a6b-960e-9de3ab596c83+10:13830:x1875987796177408:12345-192.168.201.17@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789081807.645470:0:14114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081807.645498:0:14114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10e13af600/0xb7cb3d7479d60b1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ac7f expref: -99 pid: 14114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081807.645557:0:14114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10e13af600/0xb7cb3d7479d60b1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ac7f expref: 11 pid: 14114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081807.645569:0:14114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10e13af600/0xb7cb3d7479d60b1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ac7f expref: 11 pid: 14114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081807.645579:0:14114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13af600, rc 0) 00000100:00100000:1.0:1789081807.645636:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a67ef68-2159-4a6b-960e-9de3ab596c83+11:13830:x1875987796177408:12345-192.168.201.17@tcp:101:mount.lustre.0 Request processed in 183us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081807.645643:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 91 00000100:00100000:0.0:1789081807.669053:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081807.672941:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796177536 00000100:00100000:1.0:1789081807.672958:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796177536 00000100:00100000:1.0:1789081807.673099:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 92 00000100:00100000:1.0:1789081807.673109:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a67ef68-2159-4a6b-960e-9de3ab596c83+11:13830:x1875987796177536:12345-192.168.201.17@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789081807.673457:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a67ef68-2159-4a6b-960e-9de3ab596c83+11:13830:x1875987796177536:12345-192.168.201.17@tcp:501:mount.lustre.0 Request processed in 348us (4413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081807.673465:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 92 00000100:00100000:2.0:1789081807.684926:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081807.692751:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796177664 00000100:00100000:0.0:1789081807.692767:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796177664 00000100:00100000:0.0:1789081807.692852:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 93 00000100:00100000:0.0:1789081807.692863:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a67ef68-2159-4a6b-960e-9de3ab596c83+11:13830:x1875987796177664:12345-192.168.201.17@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789081807.693265:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a67ef68-2159-4a6b-960e-9de3ab596c83+11:13830:x1875987796177664:12345-192.168.201.17@tcp:503:mount.lustre.0 Request processed in 402us (8347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081807.693275:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 93 00000100:00100000:3.0:1789081807.704799:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081807.705324:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796177792 00000100:00100000:1.0:1789081807.705340:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796177792 00000100:00100000:1.0:1789081807.705418:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 94 00000100:00100000:1.0:1789081807.705429:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a67ef68-2159-4a6b-960e-9de3ab596c83+11:13837:x1875987796177792:12345-192.168.201.17@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789081807.705876:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a67ef68-2159-4a6b-960e-9de3ab596c83+11:13837:x1875987796177792:12345-192.168.201.17@tcp:502:llog_process_th.0 Request processed in 447us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081807.705886:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 94 00000100:00100000:3.0:1789081807.732216:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081807.732916:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796177920 00000100:00100000:2.0:1789081807.733007:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796177920 00000100:00100000:2.0:1789081807.733122:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 95 00000100:00100000:2.0:1789081807.733132:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a67ef68-2159-4a6b-960e-9de3ab596c83+11:13837:x1875987796177920:12345-192.168.201.17@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789081807.733483:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a67ef68-2159-4a6b-960e-9de3ab596c83+11:13837:x1875987796177920:12345-192.168.201.17@tcp:502:llog_process_th.0 Request processed in 351us (1283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081807.733492:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 95 00000100:00100000:2.0:1789081807.752587:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081807.752681:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796178048 00000100:00100000:0.0:1789081807.752702:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796178048 00000100:00100000:0.0:1789081807.752763:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 96 00000100:00100000:0.0:1789081807.752783:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a67ef68-2159-4a6b-960e-9de3ab596c83+11:13830:x1875987796178048:12345-192.168.201.17@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789081807.752802:0:14115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081807.752822:0:14115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e1101982800/0xb7cb3d7479d60b24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2aca9 expref: -99 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081807.752859:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e1101982800/0xb7cb3d7479d60b24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aca9 expref: 12 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081807.752871:0:14115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e1101982800/0xb7cb3d7479d60b24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2aca9 expref: 12 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081807.752880:0:14115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101982800, rc 0) 00000100:00100000:0.0:1789081807.752935:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a67ef68-2159-4a6b-960e-9de3ab596c83+12:13830:x1875987796178048:12345-192.168.201.17@tcp:101:mount.lustre.0 Request processed in 164us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081807.752957:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 96 00000100:00100000:3.0:1789081807.757774:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081807.759924:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796178176 00000100:00100000:2.0:1789081807.759943:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796178176 00000100:00100000:2.0:1789081807.760026:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 97 00000100:00100000:2.0:1789081807.760038:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a67ef68-2159-4a6b-960e-9de3ab596c83+12:13830:x1875987796178176:12345-192.168.201.17@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789081807.760070:0:14114:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789081807.760098:0:14114:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789081807.760102:0:14114:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789081807.760104:0:14114:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789081807.760107:0:14114:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1789081807.764085:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a67ef68-2159-4a6b-960e-9de3ab596c83+12:13830:x1875987796178176:12345-192.168.201.17@tcp:256:mount.lustre.0 Request processed in 4033us (6567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081807.764102:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 97 00000100:00100000:3.0:1789081807.766961:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081807.767567:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796178304 00000100:00100000:2.0:1789081807.767581:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796178304 00000100:00100000:2.0:1789081807.767645:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 98 00000100:00100000:2.0:1789081807.767657:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a67ef68-2159-4a6b-960e-9de3ab596c83+12:13830:x1875987796178304:12345-192.168.201.17@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789081807.767683:0:14116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081807.767721:0:14116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e1101775400/0xb7cb3d7479d60b2b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2acb0 expref: -99 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081807.767786:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e1101775400/0xb7cb3d7479d60b2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2acb0 expref: 13 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081807.767800:0:14116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e1101775400/0xb7cb3d7479d60b2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2acb0 expref: 13 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081807.767812:0:14116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101775400, rc 0) 00000100:00100000:2.0:1789081807.767901:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a67ef68-2159-4a6b-960e-9de3ab596c83+13:13830:x1875987796178304:12345-192.168.201.17@tcp:101:mount.lustre.0 Request processed in 241us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081807.767911:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 98 00000100:00100000:3.0:1789081807.769963:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081807.770254:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796178432 00000100:00100000:2.0:1789081807.770265:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796178432 00000100:00100000:2.0:1789081807.770340:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 99 00000100:00100000:2.0:1789081807.770351:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a67ef68-2159-4a6b-960e-9de3ab596c83+13:13830:x1875987796178432:12345-192.168.201.17@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789081807.770970:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a67ef68-2159-4a6b-960e-9de3ab596c83+13:13830:x1875987796178432:12345-192.168.201.17@tcp:501:mount.lustre.0 Request processed in 615us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081807.770979:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 99 00010000:00010000:1.0:1789081807.773109:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081807.776197:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081807.776615:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796178560 00000100:00100000:0.0:1789081807.776631:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796178560 00000100:00100000:0.0:1789081807.776746:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 100 00000100:00100000:0.0:1789081807.776760:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a67ef68-2159-4a6b-960e-9de3ab596c83+13:13830:x1875987796178560:12345-192.168.201.17@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789081807.777285:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a67ef68-2159-4a6b-960e-9de3ab596c83+13:13830:x1875987796178560:12345-192.168.201.17@tcp:503:mount.lustre.0 Request processed in 524us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081807.777295:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 100 00000100:00100000:3.0:1789081807.787742:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081807.788064:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796178688 00000100:00100000:2.0:1789081807.788078:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796178688 00000100:00100000:2.0:1789081807.788154:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 101 00000100:00100000:2.0:1789081807.788166:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a67ef68-2159-4a6b-960e-9de3ab596c83+13:13841:x1875987796178688:12345-192.168.201.17@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789081807.788751:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a67ef68-2159-4a6b-960e-9de3ab596c83+13:13841:x1875987796178688:12345-192.168.201.17@tcp:502:llog_process_th.0 Request processed in 584us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081807.788762:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 101 00000100:00100000:3.0:1789081807.798181:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081807.799663:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796178816 00000100:00100000:2.0:1789081807.799715:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796178816 00000100:00100000:2.0:1789081807.799811:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 102 00000100:00100000:2.0:1789081807.799823:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a67ef68-2159-4a6b-960e-9de3ab596c83+13:13841:x1875987796178816:12345-192.168.201.17@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789081807.800171:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a67ef68-2159-4a6b-960e-9de3ab596c83+13:13841:x1875987796178816:12345-192.168.201.17@tcp:502:llog_process_th.0 Request processed in 348us (2003us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081807.800181:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 102 00000100:00100000:3.0:1789081807.819976:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081807.822507:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796178944 00000100:00100000:2.0:1789081807.822579:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796178944 00000100:00100000:2.0:1789081807.822654:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 10 00000100:00100000:2.0:1789081807.822665:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2347:x1875987796178944:12345-192.168.201.17@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789081807.822719:0:14123:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 0c6e70d6-563c-4301-b0bb-af616cc0908d@192.168.201.17@tcp t0 exp 0000000000000000 cur 474 last 0 00000020:00000080:2.0:1789081807.822778:0:14123:0:(genops.c:1406:class_connect()) connect: client 0c6e70d6-563c-4301-b0bb-af616cc0908d, cookie 0xb7cb3d7479d60b32 00000004:00100000:2.0:1789081807.822822:0:14123:0:(mdt_handler.c:7402:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789081807.822998:0:14123:0:(import.c:65:import_set_state_nolock()) ffff9e0fc3008000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789081807.823107:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c6e70d6-563c-4301-b0bb-af616cc0908d+6:2347:x1875987796178944:12345-192.168.201.17@tcp:38:mount.lustre.0 Request processed in 442us (3146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081807.823116:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 10 00000100:00100000:3.0:1789081807.837764:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081807.837819:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081807.837992:0:15260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796179072 00000100:00100000:0.0:1789081807.838007:0:15260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796179072 00000100:00100000:0.0:1789081807.838100:0:15260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796179200 00000100:00100000:0.0:1789081807.838103:0:15260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796179200 00000100:00100000:0.0:1789081807.838130:0:15260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 11 00000100:00100000:0.0:1789081807.838141:0:15260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c6e70d6-563c-4301-b0bb-af616cc0908d+7:0:x1875987796179072:12345-192.168.201.17@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789081807.838189:0:15260:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789081807.838277:0:15260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c6e70d6-563c-4301-b0bb-af616cc0908d+7:0:x1875987796179072:12345-192.168.201.17@tcp:41:mount.lustre.0 Request processed in 136us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081807.838286:0:15260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 11 00000100:00100000:0.0:1789081807.838309:0:15260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 12 00000100:00100000:0.0:1789081807.838316:0:15260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c6e70d6-563c-4301-b0bb-af616cc0908d+6:13830:x1875987796179200:12345-192.168.201.17@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789081807.838328:0:15260:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789081807.838350:0:15260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c6e70d6-563c-4301-b0bb-af616cc0908d+6:13830:x1875987796179200:12345-192.168.201.17@tcp:41:mount.lustre.0 Request processed in 35us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081807.838356:0:15260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 12 00000100:00080000:3.0:1789081807.839201:0:14117:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789081807.843667:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081807.843820:0:15260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796179328 00000100:00100000:0.0:1789081807.843833:0:15260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796179328 00000100:00100000:0.0:1789081807.843916:0:15260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 13 00000100:00100000:0.0:1789081807.843926:0:15260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c6e70d6-563c-4301-b0bb-af616cc0908d+6:13830:x1875987796179328:12345-192.168.201.17@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789081807.844053:0:15260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c6e70d6-563c-4301-b0bb-af616cc0908d+6:13830:x1875987796179328:12345-192.168.201.17@tcp:40:mount.lustre.0 Request processed in 128us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081807.844062:0:15260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 13 00000100:00100000:0.0:1789081807.848976:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081807.849038:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081807.849076:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081807.849199:0:14756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796179456 00000100:00100000:1.0:1789081807.849213:0:14756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796179456 00000100:00100000:1.0:1789081807.849272:0:14756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796179584 00000100:00100000:1.0:1789081807.849276:0:14756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796179584 00000100:00100000:1.0:1789081807.849294:0:14756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 9 00000100:00100000:1.0:1789081807.849304:0:14756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2347:x1875987796179456:12345-192.168.201.17@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789081807.849359:0:14756:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 0c6e70d6-563c-4301-b0bb-af616cc0908d@192.168.201.17@tcp t0 exp 0000000000000000 cur 474 last 0 00000020:00000080:1.0:1789081807.849402:0:14756:0:(genops.c:1406:class_connect()) connect: client 0c6e70d6-563c-4301-b0bb-af616cc0908d, cookie 0xb7cb3d7479d60b39 00002000:00100000:1.0:1789081807.849419:0:14756:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0c6e70d6-563c-4301-b0bb-af616cc0908d/ffff9e0fc21d2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113719 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789081807.849434:0:14756:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789081807.849840:0:14756:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789081807.849884:0:14756:0:(import.c:65:import_set_state_nolock()) ffff9e0fc21d3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789081807.849978:0:14756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c6e70d6-563c-4301-b0bb-af616cc0908d+6:2347:x1875987796179456:12345-192.168.201.17@tcp:8:mount.lustre.0 Request processed in 673us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081807.849988:0:14756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 9 00000100:00100000:1.0:1789081807.850015:0:14756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 10 00000100:00100000:1.0:1789081807.850021:0:14756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2347:x1875987796179584:12345-192.168.201.17@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789081807.850039:0:14756:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 0c6e70d6-563c-4301-b0bb-af616cc0908d@192.168.201.17@tcp t0 exp 0000000000000000 cur 474 last 0 00000020:00000080:1.0:1789081807.850061:0:14756:0:(genops.c:1406:class_connect()) connect: client 0c6e70d6-563c-4301-b0bb-af616cc0908d, cookie 0xb7cb3d7479d60b40 00002000:00100000:1.0:1789081807.850067:0:14756:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0c6e70d6-563c-4301-b0bb-af616cc0908d/ffff9e0fc21d3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113719 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789081807.850075:0:14756:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789081807.850228:0:14756:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789081807.850244:0:14756:0:(import.c:65:import_set_state_nolock()) ffff9e0fc21d5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789081807.850273:0:14756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c6e70d6-563c-4301-b0bb-af616cc0908d+6:2347:x1875987796179584:12345-192.168.201.17@tcp:8:mount.lustre.0 Request processed in 251us (1196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081807.850298:0:14756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 10 00000100:00100000:3.0:1789081807.851782:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796179712 00000100:00100000:3.0:1789081807.851799:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796179712 00000100:00100000:3.0:1789081807.851882:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 1 00000100:00100000:3.0:1789081807.851892:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c6e70d6-563c-4301-b0bb-af616cc0908d+6:13830:x1875987796179712:12345-192.168.201.17@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789081807.852294:0:14125:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1789081807.855123:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c6e70d6-563c-4301-b0bb-af616cc0908d+6:13830:x1875987796179712:12345-192.168.201.17@tcp:33:mount.lustre.0 Request processed in 3215us (6148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081807.855139:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 1 00000100:00100000:3.0:1789081808.034724:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081808.034862:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796179840 00000100:00100000:1.0:1789081808.034877:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796179840 00000100:00100000:1.0:1789081808.034966:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 14 00000100:00100000:1.0:1789081808.034977:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c6e70d6-563c-4301-b0bb-af616cc0908d+6:13863:x1875987796179840:12345-192.168.201.17@tcp:101:mkdir.0 00010000:00010000:1.0:1789081808.035009:0:14121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081808.035043:0:14121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afa00/0xb7cb3d7479d60b47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2acda expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081808.035128:0:14121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d60b4e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081808.035144:0:14121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d60b4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081808.035158:0:14121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d60b4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789081808.035429:0:14121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1789081808.035434:0:14121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1789081808.035520:0:14121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d60b4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081808.035598:0:14121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13afa00/0xb7cb3d7479d60b47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2acda expref: 8 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081808.035619:0:14121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d60b4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2acda expref: 7 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081808.035640:0:14121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c52f5000) 00010000:00010000:1.0:1789081808.035644:0:14121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789081808.035647:0:14121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13af400, rc 0) 00000100:00100000:1.0:1789081808.035742:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c6e70d6-563c-4301-b0bb-af616cc0908d+7:13863:x1875987796179840:12345-192.168.201.17@tcp:101:mkdir.0 Request processed in 766us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081808.035750:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 14 00010000:00010000:2.0:1789081808.796786:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789081809.757409:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821333120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789081809.757546:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081809.757754:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821333120 00000100:00100000:3.0:1789081809.757766:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821333120 00000100:00100000:3.0:1789081809.757857:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789081809.757870:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10fada7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821333120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789081809.757964:0:14761:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789081809.758075:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10fada7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821333120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 206us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081809.758084:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1789081809.758155:0:14117:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789081809.758249:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821333120:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789081809.821565:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789081810.323099:0:5811:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0c6e70d6-563c-4301-b0bb-af616cc0908d 00000001:00100000:2.0:1789081810.323119:0:5811:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ed84e792-638e-46e0-85a3-6e17c331902b 00000100:00100000:1.0:1789081810.785099:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821333248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789081810.785175:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081810.785847:0:14760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821333248 00000100:00100000:3.0:1789081810.785857:0:14760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821333248 00000100:00100000:3.0:1789081810.785932:0:14760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789081810.785941:0:14760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10fada6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821333248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789081810.785992:0:14760:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789081810.786046:0:14760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10fada6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875987821333248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081810.786054:0:14760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1789081810.786078:0:14117:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789081810.786123:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1789081810.786147:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875987821333248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789081810.789717:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821333504:0@lo:400:kworker.0 00000100:00100000:3.0:1789081810.789794:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081810.789834:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789081810.789839:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:3306:1875987821333376:0@lo:400:kworker.0 00000100:00100000:3.0:1789081810.789870:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081810.789896:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875987821333888:0@lo:400:kworker.0 00000100:00100000:3.0:1789081810.789921:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081810.790055:0:14756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821333504 00000100:00100000:3.0:1789081810.790062:0:14756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821333504 00000100:00100000:3.0:1789081810.790115:0:14756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789081810.790124:0:14756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821333504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081810.790176:0:14756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821333504:12345-0@lo:400:kworker.0 Request processed in 53us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081810.790184:0:14756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789081810.790229:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821333504:0@lo:400:kworker.0 00000100:00100000:3.0:1789081810.790327:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875987821333760:0@lo:400:kworker.0 00000100:00100000:3.0:1789081810.790355:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081810.790388:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789081810.790394:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875987821333632:0@lo:400:kworker.0 00000100:00100000:3.0:1789081810.790415:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081810.790441:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821333888 00000100:00100000:3.0:1789081810.790445:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821333888 00000100:00100000:3.0:1789081810.790477:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821333760 00000100:00100000:3.0:1789081810.790480:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821333760 00000100:00100000:3.0:1789081810.790494:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821333632 00000100:00100000:3.0:1789081810.790496:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821333632 00000100:00100000:3.0:1789081810.790510:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789081810.790516:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875987821333888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081810.790575:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875987821333888:12345-0@lo:400:kworker.0 Request processed in 58us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081810.790583:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789081810.790596:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789081810.790602:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875987821333760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081810.790632:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875987821333760:12345-0@lo:400:kworker.0 Request processed in 30us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081810.790647:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789081810.790659:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789081810.790665:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875987821333632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081810.790691:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875987821333632:12345-0@lo:400:kworker.0 Request processed in 26us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081810.790697:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1789081810.790713:0:14117:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789081810.790733:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875987821333888:0@lo:400:kworker.0 00000100:00100000:3.0:1789081810.790758:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875987821333632:0@lo:400:kworker.0 00000100:00100000:3.0:1789081810.790778:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875987821333760:0@lo:400:kworker.0 00000100:00100000:0.0:1789081810.791225:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821333376 00000100:00100000:0.0:1789081810.791231:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821333376 00000100:00100000:0.0:1789081810.791273:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789081810.791281:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+19:3306:x1875987821333376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789081810.791325:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+19:3306:x1875987821333376:12345-0@lo:400:kworker.0 Request processed in 45us (1453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081810.791331:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789081810.791514:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:3306:1875987821333376:0@lo:400:kworker.0 00010000:00010000:2.0:1789081810.847569:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789081810.887973:0:7493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0c6e70d6-563c-4301-b0bb-af616cc0908d 00000001:02000400:1.0:1789081810.899407:0:15981:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000040:00080000:3.0:1789081811.293239:0:14155:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789081811.882226:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789081811.937824:0:6607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0c6e70d6-563c-4301-b0bb-af616cc0908d 00010000:00010000:2.0:1789081812.892966:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081812.954880:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081812.954996:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081812.955044:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081812.955172:0:14758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796180224 00000100:00100000:0.0:1789081812.955186:0:14758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796180224 00000100:00100000:0.0:1789081812.955276:0:14758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 4 00000100:00100000:0.0:1789081812.955288:0:14758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed84e792-638e-46e0-85a3-6e17c331902b+5:2348:x1875987796180224:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:0.0:1789081812.955419:0:14758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed84e792-638e-46e0-85a3-6e17c331902b+5:2348:x1875987796180224:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 132us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081812.955429:0:14758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 4 00000100:00100000:3.0:1789081812.955907:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081812.955939:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081812.955993:0:14759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796180736 00000100:00100000:0.0:1789081812.955999:0:14759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796180736 00000100:00100000:0.0:1789081812.956047:0:14759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 5 00000100:00100000:0.0:1789081812.956054:0:14759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c6e70d6-563c-4301-b0bb-af616cc0908d+5:2348:x1875987796180736:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:0.0:1789081812.956097:0:14759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c6e70d6-563c-4301-b0bb-af616cc0908d+5:2348:x1875987796180736:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 44us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081812.956104:0:14759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 5 00000100:00100000:1.0:1789081812.957178:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796179968 00000100:00100000:1.0:1789081812.957189:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796179968 00000100:00100000:1.0:1789081812.957255:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 104 00000100:00100000:1.0:1789081812.957264:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a67ef68-2159-4a6b-960e-9de3ab596c83+13:2348:x1875987796179968:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:1.0:1789081812.957323:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a67ef68-2159-4a6b-960e-9de3ab596c83+13:2348:x1875987796179968:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 61us (2460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081812.957332:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 104 00000100:00100000:3.0:1789081812.960440:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081812.960474:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00080000:3.0:1789081812.960511:0:14117:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789081812.960518:0:14117:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789081812.960571:0:14756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796180352 00000100:00100000:3.0:1789081812.960583:0:14756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796180352 00000100:00100000:3.0:1789081812.960649:0:14756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796180608 00000100:00100000:3.0:1789081812.960652:0:14756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796180608 00000100:00100000:3.0:1789081812.960669:0:14756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 6 00000100:00100000:3.0:1789081812.960679:0:14756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed84e792-638e-46e0-85a3-6e17c331902b+5:2348:x1875987796180352:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081812.960773:0:14756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed84e792-638e-46e0-85a3-6e17c331902b+5:2348:x1875987796180352:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 95us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081812.960782:0:14756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 6 00000100:00100000:3.0:1789081812.960801:0:14756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 7 00000100:00100000:3.0:1789081812.960807:0:14756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c6e70d6-563c-4301-b0bb-af616cc0908d+5:2348:x1875987796180608:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081812.960842:0:14756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c6e70d6-563c-4301-b0bb-af616cc0908d+5:2348:x1875987796180608:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 34us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081812.960848:0:14756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 7 00000100:00080000:3.0:1789081812.962278:0:14117:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789081812.962290:0:14117:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789081812.963770:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796180480 00000100:00100000:2.0:1789081812.963790:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796180480 00000100:00100000:2.0:1789081812.963897:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796180096 00000100:00100000:2.0:1789081812.963901:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796180096 00000100:00100000:2.0:1789081812.963944:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 17 00000100:00100000:2.0:1789081812.963979:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c6e70d6-563c-4301-b0bb-af616cc0908d+6:2348:x1875987796180480:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:2.0:1789081812.964112:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c6e70d6-563c-4301-b0bb-af616cc0908d+6:2348:x1875987796180480:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 136us (9066us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081812.964120:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 17 00000100:00100000:2.0:1789081812.964141:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 18 00000100:00100000:2.0:1789081812.964148:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed84e792-638e-46e0-85a3-6e17c331902b+6:2348:x1875987796180096:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:2.0:1789081812.964176:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed84e792-638e-46e0-85a3-6e17c331902b+6:2348:x1875987796180096:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 29us (8238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081812.964183:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 18 00000100:00080000:3.0:1789081812.964894:0:14117:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789081813.918027:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789081814.720999:0:16130:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff0abb3dd0 20000000:00000080:1.0:1789081814.721027:0:16130:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e0fc1bcd400 uarg=0000000000000000 20000000:01000000:1.0:1789081814.721086:0:16130:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789081814.721093:0:16130:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789081814.721108:0:16130:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789081814.727551:0:16131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1789081814.727999:0:16130:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789081814.734380:0:16130:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789081814.735230:0:16130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e1101983a00/0xb7cb3d7479d60b55 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081814.735259:0:16130:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e1101983200/0xb7cb3d7479d6084c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d60845 expref: 18 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081814.735267:0:16130:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e10d1bd0e00/0xb7cb3d7479d60899 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d60892 expref: 18 pid: 14114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081814.735273:0:16130:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e1101774000/0xb7cb3d7479d609d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d609cd expref: 18 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081814.735283:0:16130:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e1101774400/0xb7cb3d7479d60af3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ac4e expref: 12 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081814.735290:0:16130:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e1101775400/0xb7cb3d7479d60b2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2acb0 expref: 12 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081814.735316:0:16130:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e1101983a00/0xb7cb3d7479d60b55 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081814.735756:0:16130:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e1101775400/0xb7cb3d7479d60b2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2acb0 expref: 12 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081814.735776:0:16130:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e1101775400/0xb7cb3d7479d60b2b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2acb0 expref: 12 pid: 14116 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081814.735795:0:16130:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b26a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16130:1875987821334016:192.168.201.17@tcp:104: 00010000:00010000:0.0:1789081814.735956:0:16130:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e1101774400/0xb7cb3d7479d60af3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ac4e expref: 12 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081814.735965:0:16130:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e1101774400/0xb7cb3d7479d60af3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ac4e expref: 12 pid: 14115 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081814.735975:0:16130:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b24e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16130:1875987821334144:192.168.201.17@tcp:104: 00010000:00010000:0.0:1789081814.736012:0:16130:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e1101774000/0xb7cb3d7479d609d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb7cb3d7479d609cd expref: 18 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081814.736020:0:16130:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e1101774000/0xb7cb3d7479d609d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb7cb3d7479d609cd expref: 18 pid: 14116 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081814.736031:0:16130:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f9b26d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16130:1875987821334272:0@lo:104: 00000100:00100000:0.0:1789081814.736084:0:16130:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789081814.736135:0:16130:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e10d1bd0e00/0xb7cb3d7479d60899 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb7cb3d7479d60892 expref: 18 pid: 14114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081814.736159:0:16130:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e10d1bd0e00/0xb7cb3d7479d60899 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb7cb3d7479d60892 expref: 18 pid: 14114 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081814.736168:0:16130:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c8a1c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16130:1875987821334400:0@lo:104: 00000100:00100000:0.0:1789081814.736192:0:16130:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789081814.736365:0:16130:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e1101983200/0xb7cb3d7479d6084c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb7cb3d7479d60845 expref: 18 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081814.736386:0:16130:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e1101983200/0xb7cb3d7479d6084c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb7cb3d7479d60845 expref: 18 pid: 14116 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081814.736396:0:16130:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c8a1d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16130:1875987821334528:0@lo:104: 00000100:00100000:0.0:1789081814.736500:0:16130:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081814.736905:0:16130:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10ff6b1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789081814.736968:0:14104:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789081814.736986:0:14104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821334272 00000100:00100000:3.0:1789081814.736995:0:14104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821334272 00000100:00100000:3.0:1789081814.737050:0:14104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821334400 00000100:00100000:3.0:1789081814.737053:0:14104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821334400 00000100:00100000:3.0:1789081814.737063:0:14104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821334528 00000100:00100000:3.0:1789081814.737065:0:14104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821334528 00000100:00100000:3.0:1789081814.737079:0:14104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789081814.737088:0:14104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+5:16130:x1875987821334272:12345-0@lo:104: 00010000:00010000:3.0:1789081814.737105:0:14104:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.117@tcp lock: ffff9e1101998600/0xb7cb3d7479d609cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d609d4 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081814.737232:0:14104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789081814.737239:0:14104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+5:16130:x1875987821334272:12345-0@lo:104: Request processed in 152us (1155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081814.737246:0:14104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789081814.737267:0:14104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789081814.737273:0:14104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c8a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+4:16130:x1875987821334400:12345-0@lo:104: 00010000:00010000:3.0:1789081814.737282:0:14104:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.117@tcp lock: ffff9e1101774800/0xb7cb3d7479d60892 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d60899 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081814.737304:0:14109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789081814.737313:0:14109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e1101998600/0xb7cb3d7479d609cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d609d4 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081814.737319:0:14104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789081814.737321:0:14109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998600 already unused, calling callback (ffffffffc1d6ac20) 00000100:00100000:3.0:1789081814.737323:0:14104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c8a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+4:16130:x1875987821334400:12345-0@lo:104: Request processed in 51us (1131us total) trans 0 rc 0/0 10000000:00010000:1.0:1789081814.737326:0:14109:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e1101998600/0xb7cb3d7479d609cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb7cb3d7479d609d4 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081814.737329:0:14104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1789081814.737335:0:14109:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e1101998600/0xb7cb3d7479d609cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb7cb3d7479d609d4 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789081814.737344:0:14109:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e1101998600/0xb7cb3d7479d609cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb7cb3d7479d609d4 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789081814.737350:0:14109:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1789081814.737351:0:14104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789081814.737357:0:14104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c56f5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+3:16130:x1875987821334528:12345-0@lo:104: 00010000:00010000:3.0:1789081814.737365:0:14104:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd1a00/0xb7cb3d7479d60845 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d6084c expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081814.737389:0:14109:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e1101998600/0xb7cb3d7479d609cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d609d4 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081814.737396:0:14109:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789081814.737416:0:14104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789081814.737421:0:14104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c56f5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+3:16130:x1875987821334528:12345-0@lo:104: Request processed in 65us (921us total) trans 0 rc 0/0 00010000:00010000:1.0:1789081814.737421:0:14109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e1101998600/0xb7cb3d7479d609cd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d609d4 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081814.737427:0:14104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1789081814.737429:0:14109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e1101998600/0xb7cb3d7479d609cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d609d4 expref: -99 pid: 15423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081814.737443:0:14109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789081814.737446:0:14109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e1101774800/0xb7cb3d7479d60892 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d60899 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081814.737452:0:14109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101774800 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:1.0:1789081814.737461:0:14109:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e1101774800/0xb7cb3d7479d60892 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb7cb3d7479d60899 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081814.737468:0:14109:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e1101774800/0xb7cb3d7479d60892 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb7cb3d7479d60899 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789081814.737474:0:14109:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e1101774800/0xb7cb3d7479d60892 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb7cb3d7479d60899 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789081814.737480:0:14109:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789081814.737494:0:14109:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e1101774800/0xb7cb3d7479d60892 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d60899 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081814.737500:0:14109:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789081814.737554:0:14109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e1101774800/0xb7cb3d7479d60892 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d60899 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081814.737562:0:14109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e1101774800/0xb7cb3d7479d60892 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d60899 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081814.737581:0:14109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789081814.737584:0:14109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd1a00/0xb7cb3d7479d60845 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb7cb3d7479d6084c expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081814.737590:0:14109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10d1bd1a00 already unused, calling callback (ffffffffc1d6ac20) 10000000:00010000:1.0:1789081814.737593:0:14109:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd1a00/0xb7cb3d7479d60845 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb7cb3d7479d6084c expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081814.737597:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:3303:1875987821334784:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789081814.737599:0:14109:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd1a00/0xb7cb3d7479d60845 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb7cb3d7479d6084c expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789081814.737616:0:14109:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd1a00/0xb7cb3d7479d60845 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb7cb3d7479d6084c expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789081814.737621:0:14109:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1789081814.737635:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789081814.737636:0:14109:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd1a00/0xb7cb3d7479d60845 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d6084c expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081814.737642:0:14109:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789081814.737648:0:14109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd1a00/0xb7cb3d7479d60845 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d6084c expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081814.737655:0:14109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.117@tcp lock: ffff9e10d1bd1a00/0xb7cb3d7479d60845 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb7cb3d7479d6084c expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081814.737665:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1789081814.737669:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081814.737670:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:3303:1875987821334912:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789081814.737671:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081814.737673:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081814.737680:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081814.737692:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081814.737699:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:3306:1875987821334656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789081814.737730:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081814.737800:0:14107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821334784 00000100:00100000:3.0:1789081814.737805:0:14107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821334784 00010000:00010000:3.0:1789081814.737829:0:14107:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e10d1bd0e00/0xb7cb3d7479d60899 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d60892 expref: 19 pid: 14114 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081814.737845:0:14107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821334912 00000100:00100000:3.0:1789081814.737848:0:14107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821334912 00010000:00010000:3.0:1789081814.737860:0:14107:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e1101983200/0xb7cb3d7479d6084c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d60845 expref: 20 pid: 14116 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081814.737870:0:14107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821334656 00000100:00100000:3.0:1789081814.737872:0:14107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821334656 00010000:00010000:3.0:1789081814.737880:0:14107:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e1101774000/0xb7cb3d7479d609d4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d609cd expref: 21 pid: 14116 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081814.737891:0:14107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789081814.737904:0:14107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+21:3303:x1875987821334784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789081814.737916:0:14107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081814.737923:0:14107:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e10d1bd0e00/0xb7cb3d7479d60899 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d60892 expref: 21 pid: 14114 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081814.737932:0:14107:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e10d1bd0e00/0xb7cb3d7479d60899 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb7cb3d7479d60892 expref: 21 pid: 14114 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081814.737952:0:14107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789081814.737990:0:14107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+21:3303:x1875987821334784:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081814.737997:0:14107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789081814.738009:0:14107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789081814.738015:0:14107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+20:3303:x1875987821334912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789081814.738023:0:14107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081814.738028:0:14107:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e1101983200/0xb7cb3d7479d6084c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d60845 expref: 20 pid: 14116 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081814.738035:0:14107:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e1101983200/0xb7cb3d7479d6084c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb7cb3d7479d60845 expref: 20 pid: 14116 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081814.738043:0:14107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789081814.738060:0:14107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+20:3303:x1875987821334912:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081814.738065:0:14107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789081814.738076:0:14107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789081814.738081:0:14107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff6dd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+19:3306:x1875987821334656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789081814.738088:0:14107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081814.738098:0:14107:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e1101774000/0xb7cb3d7479d609d4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb7cb3d7479d609cd expref: 19 pid: 14116 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081814.738107:0:14107:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e1101774000/0xb7cb3d7479d609d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb7cb3d7479d609cd expref: 19 pid: 14116 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081814.738116:0:14107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789081814.738141:0:14107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff6dd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+19:3306:x1875987821334656:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081814.738148:0:14107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789081814.738426:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:3306:1875987821334656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789081814.738462:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:3303:1875987821334912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789081814.738470:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:3303:1875987821334784:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789081814.738582:0:16130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e1101774000/0xb7cb3d7479d609d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb7cb3d7479d609cd expref: 18 pid: 14116 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081814.738595:0:16130:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b26d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16130:1875987821334272:0@lo:104: 00010000:00010000:0.0:1789081814.738606:0:16130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e10d1bd0e00/0xb7cb3d7479d60899 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb7cb3d7479d60892 expref: 17 pid: 14114 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081814.738616:0:16130:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c8a1c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16130:1875987821334400:0@lo:104: 00010000:00010000:0.0:1789081814.738625:0:16130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e1101983200/0xb7cb3d7479d6084c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb7cb3d7479d60845 expref: 16 pid: 14116 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081814.738633:0:16130:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c8a1d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16130:1875987821334528:0@lo:104: 00000100:00100000:0.0:1789081814.752094:0:16130:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b26a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16130:1875987821334016:192.168.201.17@tcp:104: 00000100:00100000:0.0:1789081814.752137:0:16130:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f9b24e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16130:1875987821334144:192.168.201.17@tcp:104: 00010000:00010000:0.0:1789081814.752184:0:16130:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e1101983a00/0xb7cb3d7479d60b55 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081814.752990:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081814.753091:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081814.759678:0:14107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796180864 00000100:00100000:3.0:1789081814.759702:0:14107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796180864 00010000:00010000:1.0:1789081814.765504:0:14107:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e1101775400/0xb7cb3d7479d60b2b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2acb0 expref: 13 pid: 14116 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081814.765595:0:14107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796180992 00000100:00100000:1.0:1789081814.765624:0:14107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796180992 00010000:00010000:1.0:1789081814.765646:0:14107:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e1101774400/0xb7cb3d7479d60af3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ac4e expref: 14 pid: 14115 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081814.765663:0:14107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 7 00000100:00100000:1.0:1789081814.765673:0:14107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a67ef68-2159-4a6b-960e-9de3ab596c83+14:2351:x1875987796180864:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789081814.765695:0:14107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789081814.765702:0:14107:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e1101775400/0xb7cb3d7479d60b2b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2acb0 expref: 14 pid: 14116 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081814.765717:0:14107:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e1101775400/0xb7cb3d7479d60b2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2acb0 expref: 14 pid: 14116 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081814.765742:0:14107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e1101775400/0xb7cb3d7479d60b2b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2acb0 expref: 14 pid: 14116 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081814.765763:0:14107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789081814.765993:0:14108:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789081814.766046:0:14107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a67ef68-2159-4a6b-960e-9de3ab596c83+13:2351:x1875987796180864:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 372us (13060us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081814.766056:0:14107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 7 00000100:00100000:1.0:1789081814.766078:0:14107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 8 00000100:00100000:1.0:1789081814.766085:0:14107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a67ef68-2159-4a6b-960e-9de3ab596c83+12:2351:x1875987796180992:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789081814.766096:0:14107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789081814.766101:0:14107:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e1101774400/0xb7cb3d7479d60af3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ac4e expref: 12 pid: 14115 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081814.766110:0:14107:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e1101774400/0xb7cb3d7479d60af3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ac4e expref: 12 pid: 14115 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081814.766134:0:14107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e1101774400/0xb7cb3d7479d60af3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ac4e expref: 12 pid: 14115 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081814.766147:0:14107:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e1101983a00/0xb7cb3d7479d60b55 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081814.766156:0:14107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e1101983a00/0xb7cb3d7479d60b55 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081814.766175:0:14107:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e1101983a00/0xb7cb3d7479d60b55 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081814.766183:0:14107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e1101983a00/0xb7cb3d7479d60b55 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081814.766190:0:14107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e1101983a00/0xb7cb3d7479d60b55 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081814.766197:0:14107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e1101983a00/0xb7cb3d7479d60b55 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081814.766204:0:14107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101983a00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:1.0:1789081814.766211:0:14107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e1101983a00/0xb7cb3d7479d60b55 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081814.766220:0:14107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e1101983a00/0xb7cb3d7479d60b55 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081814.766249:0:14107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e1101983a00/0xb7cb3d7479d60b55 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081814.766272:0:14107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789081814.766295:0:14107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a67ef68-2159-4a6b-960e-9de3ab596c83+11:2351:x1875987796180992:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 210us (13204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081814.766301:0:14107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 8 00000100:00100000:1.0:1789081814.766320:0:14108:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1789081814.766675:0:16130:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e1101983a00/0xb7cb3d7479d60b55 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081814.766684:0:16130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e1101983a00/0xb7cb3d7479d60b55 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081814.766691:0:16130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e1101983a00/0xb7cb3d7479d60b55 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081814.877000:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c8a1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821335040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789081814.877105:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081814.877659:0:14760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821335040 00000100:00100000:0.0:1789081814.877679:0:14760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821335040 00000100:00100000:0.0:1789081814.877760:0:14760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789081814.877774:0:14760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821335040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789081814.877838:0:14760:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789081814.877919:0:14760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821335040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 148us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081814.877928:0:14760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1789081814.878173:0:14117:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789081814.878242:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c8a1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821335040:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789081814.946195:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789081815.902501:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:3303:1875987821335296:0@lo:400:kworker.0 00000100:00100000:2.0:1789081815.902615:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081815.902679:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875987821335808:0@lo:400:kworker.0 00000100:00100000:2.0:1789081815.902718:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081815.902743:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789081815.902749:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821335424:0@lo:400:kworker.0 00000100:00100000:2.0:1789081815.902785:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081815.902803:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d0ef0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875987821335936:0@lo:400:kworker.0 00000100:00100000:2.0:1789081815.902823:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081815.902867:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821335296 00000100:00100000:2.0:1789081815.902875:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821335296 00000100:00100000:2.0:1789081815.902919:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789081815.902928:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+16:3303:x1875987821335296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789081815.902983:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+16:3303:x1875987821335296:12345-0@lo:400:kworker.0 Request processed in 56us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081815.902991:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789081815.903023:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821335808 00000100:00100000:2.0:1789081815.903026:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821335808 00000100:00100000:2.0:1789081815.903056:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821335936 00000100:00100000:2.0:1789081815.903059:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821335936 00000100:00100000:2.0:1789081815.903077:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789081815.903082:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875987821335808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789081815.903117:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875987821335808:12345-0@lo:400:kworker.0 Request processed in 34us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081815.903124:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789081815.903135:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789081815.903141:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875987821335936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789081815.903166:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875987821335936:12345-0@lo:400:kworker.0 Request processed in 26us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081815.903172:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1789081815.903191:0:14117:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789081815.903219:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d0ef0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875987821335936:0@lo:400:kworker.0 00000100:00100000:2.0:1789081815.903229:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:3303:1875987821335296:0@lo:400:kworker.0 00000100:00100000:2.0:1789081815.903238:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875987821335808:0@lo:400:kworker.0 00000100:00100000:3.0:1789081815.905950:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c8a1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821335168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789081815.906024:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081815.906067:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875987821335680:0@lo:400:kworker.0 00000100:00100000:1.0:1789081815.906198:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821335552:0@lo:400:kworker.0 00000100:00100000:1.0:1789081815.906231:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081815.906280:0:14759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821335424 00000100:00100000:1.0:1789081815.906288:0:14759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821335424 00000100:00100000:1.0:1789081815.906328:0:14759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821335552 00000100:00100000:1.0:1789081815.906331:0:14759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821335552 00000100:00100000:1.0:1789081815.906359:0:14759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789081815.906366:0:14759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821335424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081815.906420:0:14759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821335424:12345-0@lo:400:kworker.0 Request processed in 54us (3634us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081815.906427:0:14759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789081815.906443:0:14759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789081815.906449:0:14759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10fada4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821335552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081815.906479:0:14759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10fada4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821335552:12345-0@lo:400:kworker.0 Request processed in 30us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081815.906485:0:14759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1789081815.906499:0:14117:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789081815.906562:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821335424:0@lo:400:kworker.0 00000100:00100000:1.0:1789081815.906594:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821335552:0@lo:400:kworker.0 00000100:00100000:3.0:1789081815.912490:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081815.912604:0:15260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821335680 00000100:00100000:3.0:1789081815.912615:0:15260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821335680 00000100:00100000:3.0:1789081815.912669:0:15260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789081815.912679:0:15260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875987821335680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789081815.913135:0:15260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875987821335680:12345-0@lo:400:kworker.0 Request processed in 456us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081815.913144:0:15260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789081815.913175:0:14760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821335168 00000100:00100000:3.0:1789081815.913179:0:14760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821335168 00000100:00100000:3.0:1789081815.913208:0:14760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789081815.913215:0:14760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821335168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789081815.913246:0:14760:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789081815.913292:0:14760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875987821335168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (7267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081815.913299:0:14760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789081815.913511:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c8a1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875987821335168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789081815.913573:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875987821335680:0@lo:400:kworker.0 00010000:00010000:1.0:1789081815.965187:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789081816.094294:0:14118:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789081816.094302:0:14118:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e10f9783000 from 10 10000000:01000000:1.0:1789081816.094307:0:14118:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789081816.094353:0:14118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae800/0xb7cb3d7479d60b5c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081816.094364:0:14118:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae800/0xb7cb3d7479d60b5c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081816.094375:0:14118:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae800/0xb7cb3d7479d60b5c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081816.094402:0:14118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10fada7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14118:1875987821336064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789081816.094472:0:14118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081816.094559:0:14118:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d1656840 going to sleep for 11 seconds 00000100:00100000:2.0:1789081816.094632:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821336064 00000100:00100000:2.0:1789081816.094647:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821336064 00000100:00100000:2.0:1789081816.094715:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789081816.094724:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+16:14118:x1875987821336064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789081816.094736:0:14115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081816.094750:0:14115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e1101774000/0xb7cb3d7479d60b63 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d60b5c expref: -99 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081816.094916:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e1101774000/0xb7cb3d7479d60b63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d60b5c expref: 17 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081816.094927:0:14115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e1101774000/0xb7cb3d7479d60b63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d60b5c expref: 17 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081816.094936:0:14115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101774000, rc 0) 00000100:00100000:2.0:1789081816.094977:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+17:14118:x1875987821336064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 255us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081816.094984:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789081816.095027:0:14118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10fada7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14118:1875987821336064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789081816.095040:0:14118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae800/0xb7cb3d7479d60b5c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d60b63 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081816.095049:0:14118:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae800/0xb7cb3d7479d60b5c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d60b63 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081816.095100:0:14118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d0ef0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14118:1875987821336192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789081816.095124:0:14118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081816.095137:0:14118:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d03dcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789081816.095149:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821336192 00000100:00100000:2.0:1789081816.095159:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821336192 00000100:00100000:2.0:1789081816.095181:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789081816.095186:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+17:14118:x1875987821336192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789081816.095408:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+17:14118:x1875987821336192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 221us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081816.095415:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789081816.095445:0:14118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d0ef0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14118:1875987821336192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789081816.095471:0:14118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d0ef0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14118:1875987821336320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789081816.095504:0:14118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081816.095515:0:14118:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d03dcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789081816.095558:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821336320 00000100:00100000:2.0:1789081816.095562:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821336320 00000100:00100000:2.0:1789081816.095582:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789081816.095588:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+17:14118:x1875987821336320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789081816.097881:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+17:14118:x1875987821336320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2283us (2366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081816.097895:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789081816.101319:0:14118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d0ef0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14118:1875987821336320:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789081816.103470:0:16181:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1789081816.103801:0:14118:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789081816.103822:0:14118:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789081816.103834:0:14118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae800/0xb7cb3d7479d60b5c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d60b63 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081816.103861:0:14118:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e10e13ae800/0xb7cb3d7479d60b5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d60b63 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789081816.103871:0:14118:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789081816.103873:0:14118:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e10f98e2800 from 10 10000000:01000000:0.0:1789081816.103876:0:14118:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789081816.103913:0:14118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101982c00/0xb7cb3d7479d60b6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081816.103921:0:14118:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e1101982c00/0xb7cb3d7479d60b6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081816.103930:0:14118:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e1101982c00/0xb7cb3d7479d60b6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081816.103954:0:14118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c8a1c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14118:1875987821336448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789081816.104031:0:14118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081816.104086:0:14118:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10ff6b16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789081816.104197:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821336448 00000100:00100000:1.0:1789081816.104205:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821336448 00000100:00100000:1.0:1789081816.104295:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789081816.104305:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+17:14118:x1875987821336448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789081816.104319:0:14116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081816.104334:0:14116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10e13ae000/0xb7cb3d7479d60b71 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d60b6a expref: -99 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081816.104359:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10e13ae000/0xb7cb3d7479d60b71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d60b6a expref: 18 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081816.104381:0:14116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10e13ae000/0xb7cb3d7479d60b71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d60b6a expref: 18 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081816.104390:0:14116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13ae000, rc 0) 00000100:00100000:1.0:1789081816.104444:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+18:14118:x1875987821336448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081816.104451:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789081816.104553:0:14118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c8a1c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14118:1875987821336448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789081816.104568:0:14118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e1101982c00/0xb7cb3d7479d60b6a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d60b71 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081816.104576:0:14118:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e1101982c00/0xb7cb3d7479d60b6a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d60b71 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081816.104623:0:14118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c8a1c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14118:1875987821336576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789081816.104647:0:14118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081816.119684:0:14118:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10ff6b16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789081816.125824:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821336576 00000100:00100000:3.0:1789081816.125841:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821336576 00000100:00100000:3.0:1789081816.125899:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789081816.125909:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+18:14118:x1875987821336576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789081816.126213:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+18:14118:x1875987821336576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 304us (21563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081816.126221:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789081816.126283:0:14118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c8a1c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14118:1875987821336576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789081816.126337:0:14118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14118:1875987821336704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789081816.126380:0:14118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081816.126414:0:14118:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c50673c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789081816.126426:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821336704 00000100:00100000:3.0:1789081816.126430:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821336704 00000100:00100000:3.0:1789081816.126447:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789081816.126452:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+18:14118:x1875987821336704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789081816.126619:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+18:14118:x1875987821336704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081816.126626:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789081816.126661:0:14118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14118:1875987821336704:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789081816.129658:0:16182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789081816.130954:0:14118:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789081816.130985:0:14118:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789081816.130998:0:14118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e1101982c00/0xb7cb3d7479d60b6a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d60b71 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081816.131018:0:14118:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e1101982c00/0xb7cb3d7479d60b6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d60b71 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789081816.131030:0:14118:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789081816.131033:0:14118:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e10ff613800 from 10 10000000:01000000:3.0:1789081816.131036:0:14118:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789081816.131078:0:14118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1600/0xb7cb3d7479d60b78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081816.131086:0:14118:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1600/0xb7cb3d7479d60b78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081816.131097:0:14118:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1600/0xb7cb3d7479d60b78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081816.131125:0:14118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14118:1875987821336832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789081816.131193:0:14118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081816.131233:0:14118:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c5067f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789081816.131258:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821336832 00000100:00100000:3.0:1789081816.131265:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821336832 00000100:00100000:3.0:1789081816.131301:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789081816.131308:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c93eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+18:14118:x1875987821336832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789081816.131321:0:14115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081816.131335:0:14115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10c29e1000/0xb7cb3d7479d60b7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7cb3d7479d60b78 expref: -99 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081816.131358:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10c29e1000/0xb7cb3d7479d60b7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb7cb3d7479d60b78 expref: 19 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081816.131382:0:14115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10c29e1000/0xb7cb3d7479d60b7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb7cb3d7479d60b78 expref: 19 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081816.131390:0:14115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10c29e1000, rc 0) 00000100:00100000:3.0:1789081816.131428:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c93eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+19:14118:x1875987821336832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081816.131435:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789081816.131482:0:14118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14118:1875987821336832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789081816.131496:0:14118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1600/0xb7cb3d7479d60b78 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d60b7f expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081816.131505:0:14118:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1600/0xb7cb3d7479d60b78 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb7cb3d7479d60b7f expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081816.131586:0:14118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14118:1875987821336960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789081816.131611:0:14118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081816.131625:0:14118:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c5067f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789081816.131637:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821336960 00000100:00100000:3.0:1789081816.131640:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821336960 00000100:00100000:3.0:1789081816.131656:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789081816.131662:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+19:14118:x1875987821336960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789081816.132981:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+19:14118:x1875987821336960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1312us (1361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081816.132993:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789081816.133044:0:14118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14118:1875987821336960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789081816.133096:0:14118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14118:1875987821337088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789081816.133136:0:14118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081816.133165:0:14118:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c5067f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789081816.133180:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821337088 00000100:00100000:3.0:1789081816.133185:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821337088 00000100:00100000:3.0:1789081816.133210:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789081816.133218:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+19:14118:x1875987821337088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789081816.133359:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+19:14118:x1875987821337088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081816.133366:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789081816.133400:0:14118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e11010b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:14118:1875987821337088:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789081816.135666:0:16183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789081816.140587:0:14118:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789081816.140627:0:14118:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789081816.140640:0:14118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1600/0xb7cb3d7479d60b78 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d60b7f expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081816.140654:0:14118:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.117@tcp lock: ffff9e10c29e1600/0xb7cb3d7479d60b78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb7cb3d7479d60b7f expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081816.290874:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081816.290962:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796181120 00000100:00100000:3.0:1789081816.290973:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796181120 00000100:00100000:3.0:1789081816.291031:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 115 00000100:00100000:3.0:1789081816.291040:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a67ef68-2159-4a6b-960e-9de3ab596c83+11:13719:x1875987796181120:12345-192.168.201.17@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789081816.291058:0:14115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081816.291076:0:14115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10c29e1e00/0xb7cb3d7479d60b86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ace1 expref: -99 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081816.291122:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10c29e1e00/0xb7cb3d7479d60b86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ace1 expref: 12 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081816.291134:0:14115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10c29e1e00/0xb7cb3d7479d60b86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ace1 expref: 12 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081816.291143:0:14115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10c29e1e00, rc 0) 00000100:00100000:3.0:1789081816.291213:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a67ef68-2159-4a6b-960e-9de3ab596c83+12:13719:x1875987796181120:12345-192.168.201.17@tcp:101:ll_cfg_requeue.0 Request processed in 173us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081816.291220:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 115 00000100:00100000:3.0:1789081816.307695:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081816.307728:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796181248 00000100:00100000:3.0:1789081816.307738:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796181248 00000100:00100000:3.0:1789081816.307791:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 116 00000100:00100000:3.0:1789081816.307802:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a67ef68-2159-4a6b-960e-9de3ab596c83+12:13719:x1875987796181248:12345-192.168.201.17@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789081816.308073:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a67ef68-2159-4a6b-960e-9de3ab596c83+12:13719:x1875987796181248:12345-192.168.201.17@tcp:501:ll_cfg_requeue.0 Request processed in 272us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081816.308082:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 116 00000100:00100000:3.0:1789081816.314466:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081816.314982:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796181376 00000100:00100000:2.0:1789081816.314994:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796181376 00000100:00100000:2.0:1789081816.315052:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 117 00000100:00100000:2.0:1789081816.315061:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a67ef68-2159-4a6b-960e-9de3ab596c83+12:13719:x1875987796181376:12345-192.168.201.17@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789081816.315302:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a67ef68-2159-4a6b-960e-9de3ab596c83+12:13719:x1875987796181376:12345-192.168.201.17@tcp:503:ll_cfg_requeue.0 Request processed in 241us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081816.315311:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 117 00000100:00100000:3.0:1789081816.328845:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081816.332421:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796181504 00000100:00100000:1.0:1789081816.332436:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796181504 00000100:00100000:1.0:1789081816.332570:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 118 00000100:00100000:1.0:1789081816.332581:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a67ef68-2159-4a6b-960e-9de3ab596c83+12:13719:x1875987796181504:12345-192.168.201.17@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789081816.332601:0:14115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081816.333362:0:14115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e10e13afa00/0xb7cb3d7479d60b8d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ace8 expref: -99 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081816.333402:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e10e13afa00/0xb7cb3d7479d60b8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ace8 expref: 13 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081816.333414:0:14115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e10e13afa00/0xb7cb3d7479d60b8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ace8 expref: 13 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081816.333423:0:14115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13afa00, rc 0) 00000100:00100000:1.0:1789081816.333498:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a67ef68-2159-4a6b-960e-9de3ab596c83+13:13719:x1875987796181504:12345-192.168.201.17@tcp:101:ll_cfg_requeue.0 Request processed in 918us (4660us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081816.333506:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 118 00000100:00100000:2.0:1789081816.337640:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081816.337834:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796181632 00000100:00100000:3.0:1789081816.337845:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796181632 00000100:00100000:3.0:1789081816.337894:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 119 00000100:00100000:3.0:1789081816.337904:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a67ef68-2159-4a6b-960e-9de3ab596c83+13:13719:x1875987796181632:12345-192.168.201.17@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789081816.338190:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a67ef68-2159-4a6b-960e-9de3ab596c83+13:13719:x1875987796181632:12345-192.168.201.17@tcp:501:ll_cfg_requeue.0 Request processed in 286us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081816.338208:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 119 00000100:00100000:3.0:1789081816.340747:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081816.340843:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796181760 00000100:00100000:1.0:1789081816.340853:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796181760 00000100:00100000:1.0:1789081816.340914:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 120 00000100:00100000:1.0:1789081816.340924:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a67ef68-2159-4a6b-960e-9de3ab596c83+13:13719:x1875987796181760:12345-192.168.201.17@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789081816.341137:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a67ef68-2159-4a6b-960e-9de3ab596c83+13:13719:x1875987796181760:12345-192.168.201.17@tcp:503:ll_cfg_requeue.0 Request processed in 214us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081816.341145:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 120 00010000:00010000:1.0:1789081816.990904:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081818.013585:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789081818.073245:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081818.073296:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081818.073387:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796182016 00000100:00100000:1.0:1789081818.073398:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796182016 00000100:00100000:1.0:1789081818.073479:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 22 00000100:00100000:1.0:1789081818.073489:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c8a1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed84e792-638e-46e0-85a3-6e17c331902b+6:2350:x1875987796182016:12345-192.168.201.17@tcp:400:kworker.0 00000100:00080000:3.0:1789081818.073741:0:14117:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789081818.073923:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c8a1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed84e792-638e-46e0-85a3-6e17c331902b+6:2350:x1875987796182016:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 124us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081818.073931:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 22 00000100:00100000:2.0:1789081818.074113:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796181888 00000100:00100000:2.0:1789081818.074118:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796181888 00000100:00100000:2.0:1789081818.074156:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 121 00000100:00100000:2.0:1789081818.074163:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a67ef68-2159-4a6b-960e-9de3ab596c83+13:2351:x1875987796181888:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:2.0:1789081818.074205:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a67ef68-2159-4a6b-960e-9de3ab596c83+13:2351:x1875987796181888:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 42us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081818.074212:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 121 00000100:00100000:0.0:1789081818.076884:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081818.076935:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081818.077058:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796182400 00000100:00100000:3.0:1789081818.077076:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796182400 00000100:00100000:1.0:1789081818.077185:0:14759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796182144 00000100:00100000:1.0:1789081818.077195:0:14759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796182144 00000100:00100000:3.0:1789081818.077211:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 23 00000100:00100000:3.0:1789081818.077227:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c8a1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c6e70d6-563c-4301-b0bb-af616cc0908d+6:2351:x1875987796182400:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:1.0:1789081818.077270:0:14759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 10 00000100:00100000:1.0:1789081818.077283:0:14759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c8a1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed84e792-638e-46e0-85a3-6e17c331902b+5:2351:x1875987796182144:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081818.077357:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c8a1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c6e70d6-563c-4301-b0bb-af616cc0908d+6:2351:x1875987796182400:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 129us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081818.077359:0:14759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c8a1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed84e792-638e-46e0-85a3-6e17c331902b+5:2351:x1875987796182144:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 74us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081818.077384:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 23 00000100:00100000:1.0:1789081818.077385:0:14759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 10 00000100:00080000:0.0:1789081818.078236:0:14117:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789081818.078244:0:14117:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789081818.091634:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081818.091753:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081818.092094:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081818.092199:0:14758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796182656 00000100:00100000:0.0:1789081818.092214:0:14758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796182656 00000100:00080000:2.0:1789081818.092516:0:14117:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789081818.092585:0:14756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796182272 00000100:00100000:2.0:1789081818.092592:0:14756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796182272 00000100:00100000:2.0:1789081818.092632:0:14756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 11 00000100:00100000:2.0:1789081818.092643:0:14756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e11010b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c6e70d6-563c-4301-b0bb-af616cc0908d+5:2351:x1875987796182656:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:2.0:1789081818.092738:0:14756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e11010b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c6e70d6-563c-4301-b0bb-af616cc0908d+5:2351:x1875987796182656:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 96us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081818.092746:0:14756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 11 00000100:00100000:2.0:1789081818.092766:0:14756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 12 00000100:00100000:2.0:1789081818.092772:0:14756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed84e792-638e-46e0-85a3-6e17c331902b+5:2350:x1875987796182272:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:2.0:1789081818.092798:0:14756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed84e792-638e-46e0-85a3-6e17c331902b+5:2350:x1875987796182272:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 26us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081818.092822:0:14756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 12 00000100:00080000:2.0:1789081818.092845:0:14117:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789081818.094118:0:14756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796182528 00000100:00100000:0.0:1789081818.094134:0:14756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796182528 00000100:00100000:0.0:1789081818.094203:0:14756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 13 00000100:00100000:0.0:1789081818.094212:0:14756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c6e70d6-563c-4301-b0bb-af616cc0908d+5:2350:x1875987796182528:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:0.0:1789081818.094293:0:14756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c6e70d6-563c-4301-b0bb-af616cc0908d+5:2350:x1875987796182528:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 82us (2198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081818.094300:0:14756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 13 00000100:00080000:3.0:1789081818.096047:0:14117:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789081818.665362:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081818.665768:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796182784 00000100:00100000:1.0:1789081818.665778:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796182784 00000100:00100000:1.0:1789081818.665856:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 15 00000100:00100000:1.0:1789081818.665867:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed84e792-638e-46e0-85a3-6e17c331902b+6:14373:x1875987796182784:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789081818.665891:0:14122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081818.665943:0:14122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af200/0xb7cb3d7479d60b94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2acef expref: -99 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.666010:0:14122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af000/0xb7cb3d7479d60b9b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.666023:0:14122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af000/0xb7cb3d7479d60b9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.666037:0:14122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af000/0xb7cb3d7479d60b9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.666053:0:14122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae400/0xb7cb3d7479d60ba2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.666061:0:14122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae400/0xb7cb3d7479d60ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.666068:0:14122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae400/0xb7cb3d7479d60ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.666853:0:14122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d60ba9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.666865:0:14122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d60ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.666874:0:14122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d60ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789081818.667227:0:14122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1789081818.667231:0:14122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1789081818.667382:0:14122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d60ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.667399:0:14122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af000/0xb7cb3d7479d60b9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.667405:0:14122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af000/0xb7cb3d7479d60b9b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.667412:0:14122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af000/0xb7cb3d7479d60b9b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.667419:0:14122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13af000 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081818.667422:0:14122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af000/0xb7cb3d7479d60b9b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.667429:0:14122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af000/0xb7cb3d7479d60b9b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.667441:0:14122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c52f5000) 00010000:00010000:1.0:1789081818.667443:0:14122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789081818.667447:0:14122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af000/0xb7cb3d7479d60b9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.667453:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af000/0xb7cb3d7479d60b9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.667464:0:14122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae400/0xb7cb3d7479d60ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.667470:0:14122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae400/0xb7cb3d7479d60ba2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.667476:0:14122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae400/0xb7cb3d7479d60ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.667485:0:14122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13ae400 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081818.667488:0:14122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae400/0xb7cb3d7479d60ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.667503:0:14122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae400/0xb7cb3d7479d60ba2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.667512:0:14122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9e10c7ecf700) 00010000:00010000:1.0:1789081818.667514:0:14122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789081818.667517:0:14122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae400/0xb7cb3d7479d60ba2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.667609:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae400/0xb7cb3d7479d60ba2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.667645:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af200/0xb7cb3d7479d60b94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2acef expref: 8 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.667659:0:14122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae600/0xb7cb3d7479d60ba9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2acef expref: 7 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.667666:0:14122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e10c7ecf000) 00010000:00010000:1.0:1789081818.667668:0:14122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789081818.667671:0:14122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13ae600, rc 0) 00000100:00100000:1.0:1789081818.667737:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed84e792-638e-46e0-85a3-6e17c331902b+7:14373:x1875987796182784:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 1871us (2386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081818.667744:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 15 00000100:00100000:3.0:1789081818.676012:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081818.676147:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796183040 00000100:00100000:2.0:1789081818.676157:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796183040 00000100:00100000:2.0:1789081818.676209:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 16 00000100:00100000:2.0:1789081818.676231:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed84e792-638e-46e0-85a3-6e17c331902b+7:14373:x1875987796183040:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789081818.676253:0:14123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081818.676276:0:14123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775200/0xb7cb3d7479d60bb0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2acf6 expref: -99 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.676363:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d60bb7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.676378:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d60bb7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.676390:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d60bb7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.676445:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60bbe lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.676452:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60bbe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.676458:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60bbe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.677023:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d60bc5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.677034:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d60bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.677041:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d60bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789081818.677062:0:14123:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1789081818.677336:0:14123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d60bb7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.677345:0:14123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d60bb7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.677352:0:14123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d60bb7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.677359:0:14123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101775a00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081818.677363:0:14123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d60bb7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.677372:0:14123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d60bb7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.677385:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e10c7ecf000) 00010000:00010000:2.0:1789081818.677388:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081818.677394:0:14123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d60bb7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.677400:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d60bb7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.677415:0:14123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60bbe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.677421:0:14123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60bbe lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.677438:0:14123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60bbe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.677443:0:14123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101774c00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081818.677446:0:14123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60bbe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.677453:0:14123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60bbe lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.677462:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e10c9a92e00) 00010000:00010000:2.0:1789081818.677465:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081818.677468:0:14123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60bbe lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.677474:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60bbe lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.677906:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775200/0xb7cb3d7479d60bb0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2acf6 expref: 10 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.677922:0:14123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774800/0xb7cb3d7479d60bc5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2acf6 expref: 9 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.677929:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e10c9a92600) 00010000:00010000:2.0:1789081818.677931:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081818.677934:0:14123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101774800, rc 0) 00000100:00100000:2.0:1789081818.678002:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed84e792-638e-46e0-85a3-6e17c331902b+9:14373:x1875987796183040:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 1771us (1998us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789081818.678019:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 16 00000100:00100000:3.0:1789081818.687155:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081818.687262:0:15260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796183168 00000100:00100000:0.0:1789081818.687281:0:15260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796183168 00000100:00100000:0.0:1789081818.687377:0:15260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 17 00000100:00100000:0.0:1789081818.687389:0:15260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed84e792-638e-46e0-85a3-6e17c331902b+9:14373:x1875987796183168:12345-192.168.201.17@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789081818.688165:0:15260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed84e792-638e-46e0-85a3-6e17c331902b+9:14373:x1875987796183168:12345-192.168.201.17@tcp:59:lhsmtool_posix.0 Request processed in 773us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081818.688177:0:15260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 17 00000100:00100000:3.0:1789081818.743884:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081818.744142:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796183296 00000100:00100000:2.0:1789081818.744156:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796183296 00000100:00100000:2.0:1789081818.744242:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 18 00000100:00100000:2.0:1789081818.744254:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed84e792-638e-46e0-85a3-6e17c331902b+9:14379:x1875987796183296:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:2.0:1789081818.744287:0:14123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081818.744336:0:14123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775200/0xb7cb3d7479d60bd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2acfd expref: -99 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.744430:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60bda lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.744450:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60bda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.744466:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60bda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.744484:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d60be1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.744491:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d60be1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.744509:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d60be1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.744926:0:14123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60bda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.744948:0:14123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60bda lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.744955:0:14123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60bda lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.744962:0:14123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101774c00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081818.744967:0:14123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60bda lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.744975:0:14123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60bda lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.744990:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c52f5000) 00010000:00010000:2.0:1789081818.744993:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081818.744999:0:14123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60bda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.745005:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60bda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.745022:0:14123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d60be1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.745028:0:14123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d60be1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.745035:0:14123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d60be1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.745040:0:14123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101775a00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081818.745050:0:14123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d60be1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.745057:0:14123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d60be1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.745065:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e10c9a92e00) 00010000:00010000:2.0:1789081818.745068:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081818.745071:0:14123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d60be1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.745077:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d60be1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.745119:0:14123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775200/0xb7cb3d7479d60bd3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2acfd expref: 10 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.745132:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c52f5000) 00010000:00010000:2.0:1789081818.745135:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081818.745139:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775200/0xb7cb3d7479d60bd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2acfd expref: 10 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.745151:0:14123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101775200, rc 0) 00000100:00100000:2.0:1789081818.745257:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed84e792-638e-46e0-85a3-6e17c331902b+9:14379:x1875987796183296:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 1004us (1393us total) trans 0 rc 301/301 00000100:00100000:2.0:1789081818.745266:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 18 00000100:00100000:3.0:1789081818.750175:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081818.750662:0:14130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796183424 00000100:00100000:2.0:1789081818.750676:0:14130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796183424 00000100:00100000:2.0:1789081818.750749:0:14130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 0 00000100:00100000:2.0:1789081818.750760:0:14130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ed84e792-638e-46e0-85a3-6e17c331902b+9:14379:x1875987796183424:12345-192.168.201.17@tcp:700:lfs.0 00000100:00100000:2.0:1789081818.750906:0:14130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ed84e792-638e-46e0-85a3-6e17c331902b+9:14379:x1875987796183424:12345-192.168.201.17@tcp:700:lfs.0 Request processed in 147us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081818.750916:0:14130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 0 00000100:00100000:3.0:1789081818.762083:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081818.762503:0:15260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796183680 00000100:00100000:0.0:1789081818.762518:0:15260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796183680 00000100:00100000:0.0:1789081818.762783:0:15260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 19 00000100:00100000:0.0:1789081818.762795:0:15260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed84e792-638e-46e0-85a3-6e17c331902b+9:14379:x1875987796183680:12345-192.168.201.17@tcp:36:lfs.0 00010000:00010000:0.0:1789081818.762921:0:15260:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789081818.762959:0:15260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d60b16 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ac78 expref: 9 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081818.762983:0:15260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c52f5000) 00010000:00010000:0.0:1789081818.762988:0:15260:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789081818.764606:0:15260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983200/0xb7cb3d7479d60be8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081818.764639:0:15260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d60b4e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2acda expref: 5 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081818.764650:0:15260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983200/0xb7cb3d7479d60be8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081818.764703:0:15260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d60b4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2acda expref: 5 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081818.764722:0:15260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d60b4e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2acda expref: 5 pid: 14121 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081818.764739:0:15260:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c8a1ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15260:1875987821337216:192.168.201.17@tcp:104: 00000100:00100000:0.0:1789081818.766446:0:15260:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d12d20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789081818.770483:0:15260:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c8a1ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15260:1875987821337216:192.168.201.17@tcp:104: 00010000:00010000:0.0:1789081818.770570:0:15260:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983200/0xb7cb3d7479d60be8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081818.772740:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081818.777094:0:14107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796183808 00000100:00100000:1.0:1789081818.777154:0:14107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796183808 00010000:00010000:1.0:1789081818.777241:0:14107:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d60b4e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2acda expref: 6 pid: 14121 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081818.777318:0:14107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 9 00000100:00100000:1.0:1789081818.777330:0:14107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c6e70d6-563c-4301-b0bb-af616cc0908d+6:2351:x1875987796183808:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789081818.777353:0:14107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789081818.777362:0:14107:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d60b4e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2acda expref: 6 pid: 14121 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.777379:0:14107:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d60b4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2acda expref: 6 pid: 14121 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.777408:0:14107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d60b4e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2acda expref: 6 pid: 14121 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.777440:0:14107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c52f5000) 00010000:00010000:1.0:1789081818.777446:0:14107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983200/0xb7cb3d7479d60be8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.777457:0:14107:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983200/0xb7cb3d7479d60be8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.777466:0:14107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983200/0xb7cb3d7479d60be8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.777504:0:14107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789081818.777639:0:14107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c6e70d6-563c-4301-b0bb-af616cc0908d+5:2351:x1875987796183808:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 311us (4912us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081818.777658:0:14107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 9 00010000:00010000:0.0:1789081818.778830:0:15260:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983200/0xb7cb3d7479d60be8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081818.778860:0:15260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983200/0xb7cb3d7479d60be8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081818.778913:0:15260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d60bef lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081818.778927:0:15260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d60bef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081818.778939:0:15260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d60bef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789081818.780930:0:15260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1789081818.780952:0:15260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983200/0xb7cb3d7479d60be8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081818.780963:0:15260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983200/0xb7cb3d7479d60be8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081818.780970:0:15260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983200/0xb7cb3d7479d60be8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081818.780976:0:15260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101983200 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081818.780981:0:15260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983200/0xb7cb3d7479d60be8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081818.780991:0:15260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983200/0xb7cb3d7479d60be8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081818.781009:0:15260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c52f5000) 00010000:00010000:0.0:1789081818.781013:0:15260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081818.781028:0:15260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983200/0xb7cb3d7479d60be8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081818.781036:0:15260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983200/0xb7cb3d7479d60be8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789081818.781061:0:15260:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dfb2d74f reply state 0000000066797920 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d60bef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081818.781072:0:15260:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789081818.781229:0:15260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed84e792-638e-46e0-85a3-6e17c331902b+10:14379:x1875987796183680:12345-192.168.201.17@tcp:36:lfs.0 Request processed in 18431us (19157us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789081818.781239:0:15260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 19 00010000:00010000:1.0:1789081818.788857:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d60bef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.788882:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d60bef lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.788891:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d60bef lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.788897:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101983000 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081818.788903:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d60bef lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.788912:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d60bef lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.788935:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e10c52f5500) 00010000:00010000:1.0:1789081818.788938:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789081818.788944:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d60bef lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.788951:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983000/0xb7cb3d7479d60bef lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081818.907903:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081818.908163:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796183936 00000100:00100000:2.0:1789081818.908178:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796183936 00000100:00100000:2.0:1789081818.908261:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 20 00000100:00100000:2.0:1789081818.908274:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10fada5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed84e792-638e-46e0-85a3-6e17c331902b+9:14387:x1875987796183936:12345-192.168.201.17@tcp:101:lctl.0 00010000:00010000:2.0:1789081818.908310:0:14123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081818.908343:0:14123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775200/0xb7cb3d7479d60bf6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ad04 expref: -99 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.908449:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d60bfd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.908466:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d60bfd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.908479:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d60bfd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789081818.908619:0:14123:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1789081818.908625:0:14123:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1789081818.908676:0:14123:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d60bfd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.908707:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775200/0xb7cb3d7479d60bf6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad04 expref: 11 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.908732:0:14123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775a00/0xb7cb3d7479d60bfd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad04 expref: 10 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.908762:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c9a92e00) 00010000:00010000:2.0:1789081818.908766:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789081818.908770:0:14123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101775a00, rc 0) 00000100:00100000:2.0:1789081818.908857:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10fada5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed84e792-638e-46e0-85a3-6e17c331902b+10:14387:x1875987796183936:12345-192.168.201.17@tcp:101:lctl.0 Request processed in 584us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081818.908865:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 20 00000100:00100000:3.0:1789081818.940618:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081818.940755:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796184064 00000100:00100000:1.0:1789081818.940769:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796184064 00000100:00100000:1.0:1789081818.940864:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 21 00000100:00100000:1.0:1789081818.940877:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c6e70d6-563c-4301-b0bb-af616cc0908d+5:14388:x1875987796184064:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:1.0:1789081818.940938:0:14122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081818.940970:0:14122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d60c04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ad0b expref: -99 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.941061:0:14122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af000/0xb7cb3d7479d60c0b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.941080:0:14122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af000/0xb7cb3d7479d60c0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.941094:0:14122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af000/0xb7cb3d7479d60c0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789081818.941184:0:14122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1789081818.941189:0:14122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1789081818.941226:0:14122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af000/0xb7cb3d7479d60c0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.941257:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d60c04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad0b expref: 7 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.941280:0:14122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af000/0xb7cb3d7479d60c0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad0b expref: 6 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.941290:0:14122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c9a92e00) 00010000:00010000:1.0:1789081818.941293:0:14122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789081818.941297:0:14122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13af000, rc 0) 00000100:00100000:1.0:1789081818.941401:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c6e70d6-563c-4301-b0bb-af616cc0908d+6:14388:x1875987796184064:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 526us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081818.941409:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 21 00000100:00100000:3.0:1789081818.950250:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081818.951236:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796184192 00000100:00100000:2.0:1789081818.951250:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796184192 00000100:00100000:2.0:1789081818.951404:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 22 00000100:00100000:2.0:1789081818.951417:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c6e70d6-563c-4301-b0bb-af616cc0908d+6:14388:x1875987796184192:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:2.0:1789081818.951440:0:14123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081818.951462:0:14123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60c12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ad12 expref: -99 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.951557:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775400/0xb7cb3d7479d60c19 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.951572:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775400/0xb7cb3d7479d60c19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.951583:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775400/0xb7cb3d7479d60c19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.951596:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d60c20 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.951603:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d60c20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.951630:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d60c20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.951848:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775200/0xb7cb3d7479d60c27 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.951857:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775200/0xb7cb3d7479d60c27 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.951865:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775200/0xb7cb3d7479d60c27 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789081818.951906:0:14123:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1789081818.951910:0:14123:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789081818.951940:0:14123:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775200/0xb7cb3d7479d60c27 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.952034:0:14123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775400/0xb7cb3d7479d60c19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.952042:0:14123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775400/0xb7cb3d7479d60c19 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.952048:0:14123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775400/0xb7cb3d7479d60c19 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.952053:0:14123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101775400 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081818.952057:0:14123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775400/0xb7cb3d7479d60c19 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.952064:0:14123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775400/0xb7cb3d7479d60c19 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.952083:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c9a92e00) 00010000:00010000:2.0:1789081818.952086:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081818.952091:0:14123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775400/0xb7cb3d7479d60c19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.952097:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775400/0xb7cb3d7479d60c19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.952187:0:14123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d60c20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.952195:0:14123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d60c20 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.952200:0:14123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d60c20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.952205:0:14123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101774400 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081818.952208:0:14123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d60c20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.952215:0:14123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d60c20 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.952223:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e10c9a92b00) 00010000:00010000:2.0:1789081818.952225:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081818.952228:0:14123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d60c20 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.952234:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774400/0xb7cb3d7479d60c20 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.952277:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60c12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad12 expref: 8 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.952291:0:14123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775200/0xb7cb3d7479d60c27 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad12 expref: 7 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.952464:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e10c9a92c00) 00010000:00010000:2.0:1789081818.952466:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789081818.952469:0:14123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101775200, rc 0) 00000100:00100000:2.0:1789081818.952684:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c6e70d6-563c-4301-b0bb-af616cc0908d+7:14388:x1875987796184192:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 1269us (2443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081818.952692:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 22 00000100:00100000:2.0:1789081818.957713:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081818.957926:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796184448 00000100:00100000:1.0:1789081818.957937:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796184448 00000100:00100000:1.0:1789081818.958124:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 23 00000100:00100000:1.0:1789081818.958136:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c6e70d6-563c-4301-b0bb-af616cc0908d+7:14388:x1875987796184448:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:1.0:1789081818.958161:0:14122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081818.958187:0:14122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d60c2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ad19 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789081818.958343:0:14122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1789081818.958488:0:14122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d60c2e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad19 expref: 9 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.958514:0:14122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c9a92e00) 00010000:00010000:1.0:1789081818.958517:0:14122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789081818.958555:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d60c2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad19 expref: 9 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.958572:0:14122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13aee00, rc 0) 00000100:00100000:1.0:1789081818.958686:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c6e70d6-563c-4301-b0bb-af616cc0908d+8:14388:x1875987796184448:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 553us (985us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1789081818.958693:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 23 00000100:00100000:0.0:1789081818.963504:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081818.963620:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796184704 00000100:00100000:2.0:1789081818.963631:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796184704 00000100:00100000:2.0:1789081818.963683:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 24 00000100:00100000:2.0:1789081818.963693:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c8a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c6e70d6-563c-4301-b0bb-af616cc0908d+8:14388:x1875987796184704:12345-192.168.201.17@tcp:36:lfs.0 00010000:00010000:2.0:1789081818.963760:0:14121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789081818.963788:0:14121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775200/0xb7cb3d7479d60c27 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad12 expref: 8 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.963806:0:14121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e10c9a92c00) 00010000:00010000:2.0:1789081818.963816:0:14121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789081818.963840:0:14121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60c3c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.963853:0:14121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60c3c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081818.963880:0:14121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60c3c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789081818.964105:0:14121:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002ffe633c reply state 00000000f00469e6 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60c3c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081818.964116:0:14121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789081818.964131:0:14121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1789081818.964216:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c8a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c6e70d6-563c-4301-b0bb-af616cc0908d+9:14388:x1875987796184704:12345-192.168.201.17@tcp:36:lfs.0 Request processed in 524us (731us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789081818.964223:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 24 00000100:00100000:0.0:1789081818.968946:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081818.969401:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796184960 00000100:00100000:2.0:1789081818.969411:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796184960 00000100:00100000:2.0:1789081818.969476:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 2 00000100:00100000:2.0:1789081818.969486:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c8a1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c6e70d6-563c-4301-b0bb-af616cc0908d+9:14388:x1875987796184960:12345-192.168.201.17@tcp:35:lfs.0 00000100:00100000:2.0:1789081818.969816:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c8a1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c6e70d6-563c-4301-b0bb-af616cc0908d+10:14388:x1875987796184960:12345-192.168.201.17@tcp:35:lfs.0 Request processed in 330us (879us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789081818.969824:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 2 00010000:00010000:1.0:1789081818.972316:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60c3c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.972334:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60c3c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.972341:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60c3c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.972365:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101774c00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081818.972370:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60c3c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.972378:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60c3c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.972395:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e10c9a92b00) 00010000:00010000:1.0:1789081818.972398:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1789081818.972403:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60c3c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081818.972411:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60c3c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081818.974569:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081818.974715:0:15260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796185216 00000100:00100000:0.0:1789081818.974730:0:15260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796185216 00000100:00100000:0.0:1789081818.974792:0:15260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 25 00000100:00100000:0.0:1789081818.974802:0:15260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5ddb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c6e70d6-563c-4301-b0bb-af616cc0908d+9:14388:x1875987796185216:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:0.0:1789081818.974827:0:15260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081818.974848:0:15260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983e00/0xb7cb3d7479d60c43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ad20 expref: -99 pid: 15260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081818.974924:0:15260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d60c4a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081818.974938:0:15260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d60c4a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081818.974950:0:15260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d60c4a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081818.974992:0:15260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d60c51 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081818.974999:0:15260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d60c51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081818.975006:0:15260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d60c51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789081818.975147:0:15260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1789081818.975238:0:15260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d60c4a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081818.975246:0:15260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d60c4a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081818.975252:0:15260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d60c4a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081818.975258:0:15260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101983c00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081818.975262:0:15260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d60c4a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081818.975269:0:15260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d60c4a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081818.975279:0:15260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c9a92e00) 00010000:00010000:0.0:1789081818.975281:0:15260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081818.975285:0:15260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d60c4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081818.975316:0:15260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d60c4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081818.975330:0:15260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d60c51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081818.975336:0:15260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d60c51 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081818.975341:0:15260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d60c51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081818.975346:0:15260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101982400 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081818.975349:0:15260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d60c51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081818.975356:0:15260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d60c51 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081818.975364:0:15260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e10c52f5000) 00010000:00010000:0.0:1789081818.975366:0:15260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081818.975369:0:15260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d60c51 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081818.975375:0:15260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d60c51 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081818.975415:0:15260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983e00/0xb7cb3d7479d60c43 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad20 expref: 11 pid: 15260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081818.975438:0:15260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c9a92e00) 00010000:00010000:0.0:1789081818.975441:0:15260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789081818.975445:0:15260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983e00/0xb7cb3d7479d60c43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad20 expref: 11 pid: 15260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081818.975455:0:15260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101983e00, rc 0) 00000100:00100000:0.0:1789081818.975569:0:15260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5ddb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c6e70d6-563c-4301-b0bb-af616cc0908d+10:14388:x1875987796185216:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 768us (1011us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1789081818.975578:0:15260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 25 00000100:00100000:0.0:1789081818.980179:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081818.980395:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796185344 00000100:00100000:3.0:1789081818.980406:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796185344 00000100:00100000:3.0:1789081818.980467:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 26 00000100:00100000:3.0:1789081818.980478:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c8a1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c6e70d6-563c-4301-b0bb-af616cc0908d+10:14388:x1875987796185344:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:3.0:1789081818.980557:0:14123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081818.980585:0:14123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0600/0xb7cb3d7479d60c5f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ad27 expref: -99 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081818.980669:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0400/0xb7cb3d7479d60c66 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081818.980683:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0400/0xb7cb3d7479d60c66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081818.980694:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0400/0xb7cb3d7479d60c66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789081818.980747:0:14123:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1789081818.980752:0:14123:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789081818.980775:0:14123:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0400/0xb7cb3d7479d60c66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081818.980802:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0600/0xb7cb3d7479d60c5f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad27 expref: 12 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081818.980822:0:14123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0400/0xb7cb3d7479d60c66 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad27 expref: 11 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081818.980830:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e10d04eef00) 00010000:00010000:3.0:1789081818.980833:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789081818.980837:0:14123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10c29e0400, rc 0) 00000100:00100000:3.0:1789081818.980901:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c8a1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c6e70d6-563c-4301-b0bb-af616cc0908d+11:14388:x1875987796185344:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 424us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081818.980908:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 26 00000100:00100000:0.0:1789081818.985338:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081818.985476:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796185472 00000100:00100000:2.0:1789081818.985487:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796185472 00000100:00100000:2.0:1789081818.985588:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 3 00000100:00100000:2.0:1789081818.985600:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c8a1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c6e70d6-563c-4301-b0bb-af616cc0908d+11:14388:x1875987796185472:12345-192.168.201.17@tcp:37:lfs.0 00000100:00100000:0.0:1789081818.991773:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c8a1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c6e70d6-563c-4301-b0bb-af616cc0908d+11:14388:x1875987796185472:12345-192.168.201.17@tcp:37:lfs.0 Request processed in 6161us (6430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081818.991791:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 3 00000100:00100000:2.0:1789081818.996258:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081818.996332:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796185728 00000100:00100000:3.0:1789081818.996343:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796185728 00000100:00100000:3.0:1789081818.996409:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 4 00000100:00100000:3.0:1789081818.996421:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c9242450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c6e70d6-563c-4301-b0bb-af616cc0908d+11:14388:x1875987796185728:12345-192.168.201.17@tcp:35:lfs.0 00000100:00100000:3.0:1789081818.997241:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c9242450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c6e70d6-563c-4301-b0bb-af616cc0908d+12:14388:x1875987796185728:12345-192.168.201.17@tcp:35:lfs.0 Request processed in 819us (988us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1789081818.997253:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 4 00010000:00010000:1.0:1789081819.038253:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789081819.066157:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081819.066255:0:15260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796185856 00000100:00100000:0.0:1789081819.066265:0:15260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796185856 00000100:00100000:0.0:1789081819.066328:0:15260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 27 00000100:00100000:0.0:1789081819.066337:0:15260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed84e792-638e-46e0-85a3-6e17c331902b+10:14394:x1875987796185856:12345-192.168.201.17@tcp:101:bash.0 00010000:00010000:0.0:1789081819.066358:0:15260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081819.066378:0:15260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d60c6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ad2e expref: -99 pid: 15260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.066438:0:15260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d60c74 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.066453:0:15260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d60c74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.066477:0:15260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d60c74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.066501:0:15260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d60c7b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.066509:0:15260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d60c7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.066516:0:15260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d60c7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.066655:0:15260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983e00/0xb7cb3d7479d60c82 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.066663:0:15260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983e00/0xb7cb3d7479d60c82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.066670:0:15260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983e00/0xb7cb3d7479d60c82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789081819.066697:0:15260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1789081819.066701:0:15260:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789081819.066739:0:15260:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983e00/0xb7cb3d7479d60c82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.066751:0:15260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d60c74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.066758:0:15260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d60c74 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.066775:0:15260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d60c74 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.066780:0:15260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101983800 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081819.066784:0:15260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d60c74 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.066792:0:15260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d60c74 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.066804:0:15260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c9a92e00) 00010000:00010000:0.0:1789081819.066807:0:15260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081819.066812:0:15260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d60c74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.066818:0:15260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d60c74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.066832:0:15260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d60c7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.066838:0:15260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d60c7b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.066843:0:15260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d60c7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.066849:0:15260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101982400 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:0.0:1789081819.066851:0:15260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d60c7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.066868:0:15260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d60c7b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.066875:0:15260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e10c52f5000) 00010000:00010000:0.0:1789081819.066879:0:15260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789081819.066882:0:15260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d60c7b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.066887:0:15260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d60c7b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.066918:0:15260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983c00/0xb7cb3d7479d60c6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad2e expref: 12 pid: 15260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.066929:0:15260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983e00/0xb7cb3d7479d60c82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad2e expref: 11 pid: 15260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.066936:0:15260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e10d04eef00) 00010000:00010000:0.0:1789081819.066938:0:15260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789081819.066940:0:15260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101983e00, rc 0) 00000100:00100000:0.0:1789081819.066992:0:15260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed84e792-638e-46e0-85a3-6e17c331902b+11:14394:x1875987796185856:12345-192.168.201.17@tcp:101:bash.0 Request processed in 656us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081819.066999:0:15260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 27 00000100:00100000:0.0:1789081819.071743:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081819.071950:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796186112 00000100:00100000:3.0:1789081819.071972:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796186112 00000100:00100000:3.0:1789081819.072036:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 28 00000100:00100000:3.0:1789081819.072045:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c8a1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed84e792-638e-46e0-85a3-6e17c331902b+11:14394:x1875987796186112:12345-192.168.201.17@tcp:101:bash.0 00010000:00010000:3.0:1789081819.072067:0:14123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081819.072089:0:14123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0600/0xb7cb3d7479d60c89 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ad35 expref: -99 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081819.072236:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0000/0xb7cb3d7479d60c90 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081819.072252:0:14123:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0400/0xb7cb3d7479d60c66 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad27 expref: 11 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081819.072262:0:14123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0000/0xb7cb3d7479d60c90 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081819.072307:0:14123:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0400/0xb7cb3d7479d60c66 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad27 expref: 11 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081819.072321:0:14123:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0400/0xb7cb3d7479d60c66 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad27 expref: 11 pid: 14123 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081819.072350:0:14123:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5dd8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14123:1875987821337344:192.168.201.17@tcp:104: 00000100:00100000:3.0:1789081819.072449:0:14123:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10ff6b1180 going to sleep for 11 seconds 00000100:00100000:1.0:1789081819.076345:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081819.076466:0:16132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796186240 00000100:00100000:2.0:1789081819.076475:0:16132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796186240 00010000:00010000:2.0:1789081819.076558:0:16132:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0400/0xb7cb3d7479d60c66 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad27 expref: 12 pid: 14123 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081819.076602:0:16132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 10 00000100:00100000:2.0:1789081819.076610:0:16132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10fada7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c6e70d6-563c-4301-b0bb-af616cc0908d+12:2350:x1875987796186240:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789081819.076627:0:16132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789081819.076633:0:16132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0400/0xb7cb3d7479d60c66 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad27 expref: 12 pid: 14123 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081819.076645:0:16132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0400/0xb7cb3d7479d60c66 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad27 expref: 12 pid: 14123 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081819.076668:0:16132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e10d04eef00) 00010000:00010000:2.0:1789081819.076673:0:16132:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0000/0xb7cb3d7479d60c90 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081819.076684:0:16132:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0000/0xb7cb3d7479d60c90 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081819.076691:0:16132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0000/0xb7cb3d7479d60c90 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081819.076708:0:16132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789081819.076759:0:16132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10fada7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c6e70d6-563c-4301-b0bb-af616cc0908d+12:2350:x1875987796186240:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 149us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081819.076767:0:16132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 10 00010000:00010000:3.0:1789081819.077926:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0400/0xb7cb3d7479d60c66 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad27 expref: 11 pid: 14123 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081819.077946:0:14123:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5dd8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14123:1875987821337344:192.168.201.17@tcp:104: 00010000:00010000:3.0:1789081819.078038:0:14123:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0000/0xb7cb3d7479d60c90 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081819.078049:0:14123:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0000/0xb7cb3d7479d60c90 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081819.078054:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0000/0xb7cb3d7479d60c90 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081819.078133:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e1c00/0xb7cb3d7479d60c97 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081819.078145:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e1c00/0xb7cb3d7479d60c97 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081819.078154:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e1c00/0xb7cb3d7479d60c97 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081819.079424:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60c9e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081819.079439:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60c9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081819.079458:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60c9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789081819.079471:0:14123:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789081819.079510:0:14123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0000/0xb7cb3d7479d60c90 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081819.079517:0:14123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0000/0xb7cb3d7479d60c90 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081819.079562:0:14123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0000/0xb7cb3d7479d60c90 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081819.079569:0:14123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10c29e0000 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081819.079574:0:14123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0000/0xb7cb3d7479d60c90 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081819.079580:0:14123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0000/0xb7cb3d7479d60c90 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081819.079592:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e10d04eef00) 00010000:00010000:3.0:1789081819.079594:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081819.079598:0:14123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0000/0xb7cb3d7479d60c90 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081819.079604:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0000/0xb7cb3d7479d60c90 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789081819.079616:0:14123:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b9ed446b reply state 0000000069776c9d transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e1c00/0xb7cb3d7479d60c97 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081819.079635:0:14123:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789081819.079669:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0600/0xb7cb3d7479d60c89 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad35 expref: 14 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081819.079683:0:14123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60c9e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad35 expref: 13 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081819.079690:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e10d04ee300) 00010000:00010000:3.0:1789081819.079692:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789081819.079694:0:14123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10c29e0c00, rc 0) 00000100:00100000:3.0:1789081819.079759:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c8a1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed84e792-638e-46e0-85a3-6e17c331902b+14:14394:x1875987796186112:12345-192.168.201.17@tcp:101:bash.0 Request processed in 7714us (8026us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1789081819.079767:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 28 00010000:00010000:3.0:1789081819.084799:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e1c00/0xb7cb3d7479d60c97 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081819.084816:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e1c00/0xb7cb3d7479d60c97 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081819.084823:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e1c00/0xb7cb3d7479d60c97 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081819.084829:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10c29e1c00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081819.084833:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e1c00/0xb7cb3d7479d60c97 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081819.084841:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e1c00/0xb7cb3d7479d60c97 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081819.084877:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9e10d04eed00) 00010000:00010000:3.0:1789081819.084881:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081819.084886:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e1c00/0xb7cb3d7479d60c97 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081819.084893:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e1c00/0xb7cb3d7479d60c97 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081819.097212:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081819.097546:0:15260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796186368 00000100:00100000:0.0:1789081819.097557:0:15260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796186368 00000100:00100000:0.0:1789081819.097624:0:15260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 29 00000100:00100000:0.0:1789081819.097634:0:15260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10fada7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed84e792-638e-46e0-85a3-6e17c331902b+13:14394:x1875987796186368:12345-192.168.201.17@tcp:101:bash.0 00010000:00010000:0.0:1789081819.097672:0:15260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081819.097695:0:15260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d60cac lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ad3c expref: -99 pid: 15260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.097763:0:15260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d60cb3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.097777:0:15260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d60cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.097788:0:15260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d60cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789081819.097827:0:15260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789081819.097832:0:15260:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789081819.097849:0:15260:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d60cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.097860:0:15260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d60cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.097884:0:15260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d60cac lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad3c expref: 15 pid: 15260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.097903:0:15260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d60cb3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad3c expref: 14 pid: 15260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.097912:0:15260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e10d04ee300) 00010000:00010000:0.0:1789081819.097915:0:15260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789081819.097919:0:15260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101983800, rc 0) 00000100:00100000:0.0:1789081819.098207:0:15260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10fada7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed84e792-638e-46e0-85a3-6e17c331902b+14:14394:x1875987796186368:12345-192.168.201.17@tcp:101:bash.0 Request processed in 572us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081819.098215:0:15260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 29 00000100:00100000:1.0:1789081819.107877:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081819.107972:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796186624 00000100:00100000:0.0:1789081819.107982:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796186624 00000100:00100000:0.0:1789081819.108039:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 5 00000100:00100000:0.0:1789081819.108049:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10fada6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed84e792-638e-46e0-85a3-6e17c331902b+14:14394:x1875987796186624:12345-192.168.201.17@tcp:35:bash.0 00000100:00100000:0.0:1789081819.108452:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10fada6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed84e792-638e-46e0-85a3-6e17c331902b+15:14394:x1875987796186624:12345-192.168.201.17@tcp:35:bash.0 Request processed in 403us (585us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1789081819.108460:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 5 00000100:00100000:3.0:1789081819.247572:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081819.247662:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796186880 00000100:00100000:1.0:1789081819.247674:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796186880 00000100:00100000:1.0:1789081819.247744:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 30 00000100:00100000:1.0:1789081819.247754:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed84e792-638e-46e0-85a3-6e17c331902b+15:14404:x1875987796186880:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:1.0:1789081819.247781:0:14122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081819.247804:0:14122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae400/0xb7cb3d7479d60cba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ad43 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789081819.247927:0:14122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1789081819.248079:0:14122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae400/0xb7cb3d7479d60cba lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad43 expref: 17 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081819.248094:0:14122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e10c9a92e00) 00010000:00010000:1.0:1789081819.248097:0:14122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789081819.248102:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae400/0xb7cb3d7479d60cba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad43 expref: 17 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081819.248114:0:14122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13ae400, rc 0) 00000100:00100000:1.0:1789081819.248186:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed84e792-638e-46e0-85a3-6e17c331902b+16:14404:x1875987796186880:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 432us (626us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1789081819.248193:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 30 00000100:00100000:1.0:1789081819.258102:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081819.258180:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796187136 00000100:00100000:0.0:1789081819.258191:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796187136 00000100:00100000:0.0:1789081819.258259:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 6 00000100:00100000:0.0:1789081819.258270:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10fada4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed84e792-638e-46e0-85a3-6e17c331902b+16:14404:x1875987796187136:12345-192.168.201.17@tcp:35:lfs.0 00000100:00100000:0.0:1789081819.258601:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10fada4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed84e792-638e-46e0-85a3-6e17c331902b+17:14404:x1875987796187136:12345-192.168.201.17@tcp:35:lfs.0 Request processed in 333us (511us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1789081819.258610:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 6 00000100:00100000:2.0:1789081819.334384:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081819.334476:0:15260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796187392 00000100:00100000:0.0:1789081819.334496:0:15260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796187392 00000100:00100000:0.0:1789081819.334573:0:15260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 31 00000100:00100000:0.0:1789081819.334582:0:15260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed84e792-638e-46e0-85a3-6e17c331902b+17:14407:x1875987796187392:12345-192.168.201.17@tcp:101:lfs.0 00010000:00010000:0.0:1789081819.334606:0:15260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081819.334629:0:15260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d60cc8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ad4a expref: -99 pid: 15260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.334732:0:15260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983a00/0xb7cb3d7479d60ccf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.334754:0:15260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983a00/0xb7cb3d7479d60ccf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.334765:0:15260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983a00/0xb7cb3d7479d60ccf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789081819.334775:0:15260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789081819.334884:0:15260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d60cc8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad4a expref: 20 pid: 15260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.334898:0:15260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983a00/0xb7cb3d7479d60ccf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad4a expref: 19 pid: 15260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.334904:0:15260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e10d04ee300) 00010000:00010000:0.0:1789081819.334906:0:15260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789081819.334909:0:15260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101983a00, rc 0) 00000100:00100000:0.0:1789081819.334968:0:15260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed84e792-638e-46e0-85a3-6e17c331902b+19:14407:x1875987796187392:12345-192.168.201.17@tcp:101:lfs.0 Request processed in 388us (593us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1789081819.334973:0:15260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 31 00000100:00100000:1.0:1789081819.342629:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081819.342871:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796187520 00000100:00100000:2.0:1789081819.342882:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796187520 00000100:00100000:2.0:1789081819.342956:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 32 00000100:00100000:2.0:1789081819.342981:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10fada7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed84e792-638e-46e0-85a3-6e17c331902b+19:14407:x1875987796187520:12345-192.168.201.17@tcp:54:lfs.0 00010000:00010000:2.0:1789081819.343047:0:14122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d60cdd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081819.343064:0:14122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d60cdd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081819.343076:0:14122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d60cdd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081819.343115:0:14122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d60cdd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081819.343122:0:14122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d60cdd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081819.343129:0:14122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d60cdd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081819.343136:0:14122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101775000 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081819.343140:0:14122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d60cdd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081819.343147:0:14122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d60cdd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081819.343159:0:14122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e10d04ee300) 00010000:00010000:2.0:1789081819.343162:0:14122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789081819.343167:0:14122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d60cdd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081819.343174:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775000/0xb7cb3d7479d60cdd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081819.343258:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10fada7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed84e792-638e-46e0-85a3-6e17c331902b+19:14407:x1875987796187520:12345-192.168.201.17@tcp:54:lfs.0 Request processed in 279us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081819.343266:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 32 00000100:00100000:2.0:1789081819.347173:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081819.347264:0:14107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796187648 00000100:00100000:1.0:1789081819.347274:0:14107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796187648 00000100:00100000:1.0:1789081819.347355:0:14107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 0 00000100:00100000:1.0:1789081819.347366:0:14107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed84e792-638e-46e0-85a3-6e17c331902b+19:2351:x1875987796187648:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789081819.347383:0:14107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789081819.347409:0:14107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983a00/0xb7cb3d7479d60ccf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad4a expref: 19 pid: 15260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081819.347427:0:14107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e10d04ee300) 00010000:00010000:1.0:1789081819.347431:0:14107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789081819.347501:0:14107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed84e792-638e-46e0-85a3-6e17c331902b+18:2351:x1875987796187648:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 137us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081819.347509:0:14107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 0 00000100:00100000:1.0:1789081819.350579:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081819.350654:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796187904 00000100:00100000:0.0:1789081819.350664:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796187904 00000100:00100000:0.0:1789081819.350721:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 7 00000100:00100000:0.0:1789081819.350731:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed84e792-638e-46e0-85a3-6e17c331902b+18:14407:x1875987796187904:12345-192.168.201.17@tcp:35:lfs.0 00000100:00100000:0.0:1789081819.350959:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed84e792-638e-46e0-85a3-6e17c331902b+19:14407:x1875987796187904:12345-192.168.201.17@tcp:35:lfs.0 Request processed in 229us (389us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1789081819.350967:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 7 00000040:00080000:3.0:1789081819.485235:0:14155:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789081819.759940:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081819.760053:0:15260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796188160 00000100:00100000:0.0:1789081819.760079:0:15260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796188160 00000100:00100000:0.0:1789081819.760268:0:15260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 33 00000100:00100000:0.0:1789081819.760291:0:15260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5dd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed84e792-638e-46e0-85a3-6e17c331902b+19:14438:x1875987796188160:12345-192.168.201.17@tcp:101:cat.0 00010000:00010000:0.0:1789081819.760317:0:15260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081819.760339:0:15260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d60ce4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ad51 expref: -99 pid: 15260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.760448:0:15260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983200/0xb7cb3d7479d60ceb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.760463:0:15260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983200/0xb7cb3d7479d60ceb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.760474:0:15260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983200/0xb7cb3d7479d60ceb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789081819.760517:0:15260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789081819.760702:0:15260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982400/0xb7cb3d7479d60ce4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad51 expref: 22 pid: 15260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.760720:0:15260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983200/0xb7cb3d7479d60ceb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad51 expref: 21 pid: 15260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081819.760728:0:15260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e10d04ee300) 00010000:00010000:0.0:1789081819.760731:0:15260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789081819.760735:0:15260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101983200, rc 0) 00000100:00100000:0.0:1789081819.762044:0:15260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5dd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed84e792-638e-46e0-85a3-6e17c331902b+21:14438:x1875987796188160:12345-192.168.201.17@tcp:101:cat.0 Request processed in 1759us (2108us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1789081819.762056:0:15260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 33 00000100:00100000:2.0:1789081819.768006:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081819.768056:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081819.768090:0:16132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796188544 00000100:00100000:2.0:1789081819.768110:0:16132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796188544 00000100:00100000:2.0:1789081819.768175:0:16132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 1 00000100:00100000:2.0:1789081819.768186:0:16132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed84e792-638e-46e0-85a3-6e17c331902b+21:2350:x1875987796188544:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789081819.768203:0:16132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789081819.768227:0:16132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983200/0xb7cb3d7479d60ceb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad51 expref: 21 pid: 15260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081819.768245:0:16132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e10d04ee300) 00010000:00010000:2.0:1789081819.768250:0:16132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789081819.768313:0:16132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed84e792-638e-46e0-85a3-6e17c331902b+20:2350:x1875987796188544:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 129us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081819.768321:0:16132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 1 00000100:00100000:3.0:1789081819.768557:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796188416 00000100:00100000:3.0:1789081819.768562:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796188416 00000100:00100000:3.0:1789081819.768589:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 8 00000100:00100000:3.0:1789081819.768595:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed84e792-638e-46e0-85a3-6e17c331902b+20:14438:x1875987796188416:12345-192.168.201.17@tcp:35:cat.0 00000100:00100000:3.0:1789081819.768895:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed84e792-638e-46e0-85a3-6e17c331902b+21:14438:x1875987796188416:12345-192.168.201.17@tcp:35:cat.0 Request processed in 299us (898us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1789081819.768902:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 8 00000100:00100000:2.0:1789081819.850928:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081819.851099:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796188800 00000100:00100000:1.0:1789081819.851110:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796188800 00000100:00100000:1.0:1789081819.851175:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 34 00000100:00100000:1.0:1789081819.851185:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed84e792-638e-46e0-85a3-6e17c331902b+21:14444:x1875987796188800:12345-192.168.201.17@tcp:101:dd.0 00010000:00010000:1.0:1789081819.851212:0:14122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081819.851234:0:14122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af200/0xb7cb3d7479d60cf9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ad58 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081819.851343:0:14122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae400/0xb7cb3d7479d60d00 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081819.851358:0:14122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60c9e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad35 expref: 22 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081819.851366:0:14122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d60cb3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad3c expref: 22 pid: 15260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081819.851374:0:14122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae400/0xb7cb3d7479d60d00 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081819.851407:0:14122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d60cb3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad3c expref: 22 pid: 15260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081819.851420:0:14122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d60cb3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad3c expref: 22 pid: 15260 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081819.851434:0:14122:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c78700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14122:1875987821337472:192.168.201.17@tcp:104: 00010000:00010000:1.0:1789081819.851701:0:14122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60c9e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad35 expref: 22 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081819.851725:0:14122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60c9e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad35 expref: 22 pid: 14123 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081819.851736:0:14122:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c79180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14122:1875987821337600:192.168.201.17@tcp:104: 00000100:00100000:1.0:1789081819.851762:0:14122:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d16566c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789081819.855177:0:14122:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c78700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14122:1875987821337472:192.168.201.17@tcp:104: 00000100:00100000:1.0:1789081819.855195:0:14122:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c79180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14122:1875987821337600:192.168.201.17@tcp:104: 00010000:00010000:1.0:1789081819.855219:0:14122:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae400/0xb7cb3d7479d60d00 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081819.858631:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081819.858678:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081819.858819:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796189056 00000100:00100000:1.0:1789081819.858829:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796189056 00010000:00010000:1.0:1789081819.858873:0:14108:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60c9e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad35 expref: 23 pid: 14123 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081819.858903:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796188928 00000100:00100000:1.0:1789081819.858905:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796188928 00010000:00010000:1.0:1789081819.858914:0:14108:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d60cb3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad3c expref: 24 pid: 15260 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081819.858933:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 11 00000100:00100000:1.0:1789081819.858939:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff6dd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed84e792-638e-46e0-85a3-6e17c331902b+24:2351:x1875987796189056:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789081819.858951:0:14108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789081819.858956:0:14108:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60c9e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad35 expref: 24 pid: 14123 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081819.858982:0:14108:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60c9e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad35 expref: 24 pid: 14123 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081819.859000:0:14108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60c9e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad35 expref: 24 pid: 14123 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081819.859014:0:14108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e10d04ee300) 00010000:00010000:1.0:1789081819.859022:0:14108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae400/0xb7cb3d7479d60d00 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081819.859029:0:14108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae400/0xb7cb3d7479d60d00 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081819.859033:0:14108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789081819.859076:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff6dd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed84e792-638e-46e0-85a3-6e17c331902b+23:2351:x1875987796189056:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 137us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081819.859080:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 11 00000100:00100000:1.0:1789081819.859120:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 12 00000100:00100000:1.0:1789081819.859124:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed84e792-638e-46e0-85a3-6e17c331902b+22:2350:x1875987796188928:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789081819.859130:0:14108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789081819.859133:0:14108:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d60cb3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad3c expref: 22 pid: 15260 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081819.859140:0:14108:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d60cb3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad3c expref: 22 pid: 15260 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081819.859156:0:14108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983800/0xb7cb3d7479d60cb3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad3c expref: 22 pid: 15260 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081819.859162:0:14108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e10d04ee300) 00010000:00010000:1.0:1789081819.859165:0:14108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae400/0xb7cb3d7479d60d00 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081819.859170:0:14108:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae400/0xb7cb3d7479d60d00 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081819.859175:0:14108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae400/0xb7cb3d7479d60d00 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081819.859191:0:14108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789081819.859204:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed84e792-638e-46e0-85a3-6e17c331902b+21:2350:x1875987796188928:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 80us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081819.859208:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 12 00010000:00010000:1.0:1789081819.859224:0:14122:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae400/0xb7cb3d7479d60d00 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081819.859231:0:14122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae400/0xb7cb3d7479d60d00 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789081819.859249:0:14122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789081819.859399:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af200/0xb7cb3d7479d60cf9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad58 expref: 22 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081819.859410:0:14122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13ae400/0xb7cb3d7479d60d00 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad58 expref: 21 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081819.859423:0:14122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e10d04ee300) 00010000:00010000:1.0:1789081819.859425:0:14122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789081819.859427:0:14122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10e13ae400, rc 0) 00000100:00100000:1.0:1789081819.859445:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed84e792-638e-46e0-85a3-6e17c331902b+21:14444:x1875987796188800:12345-192.168.201.17@tcp:101:dd.0 Request processed in 8264us (8530us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1789081819.859450:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 34 00000100:00100000:3.0:1789081819.864982:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081819.865078:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796189312 00000100:00100000:1.0:1789081819.865088:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796189312 00000100:00100000:1.0:1789081819.865159:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 35 00000100:00100000:1.0:1789081819.865169:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5dd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed84e792-638e-46e0-85a3-6e17c331902b+21:14444:x1875987796189312:12345-192.168.201.17@tcp:36:dd.0 00010000:00010000:1.0:1789081819.865461:0:14121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af200/0xb7cb3d7479d60d0e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081819.865491:0:14121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af200/0xb7cb3d7479d60d0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081819.865504:0:14121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af200/0xb7cb3d7479d60d0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789081819.865582:0:14121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1789081819.865609:0:14121:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004b9c8a62 reply state 0000000024809da2 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af200/0xb7cb3d7479d60d0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081819.865619:0:14121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789081819.865712:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5dd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed84e792-638e-46e0-85a3-6e17c331902b+24:14444:x1875987796189312:12345-192.168.201.17@tcp:36:dd.0 Request processed in 544us (740us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1789081819.865719:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 35 00000020:00080000:1.0:1789081819.865738:0:14121:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789081819.871376:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00010000:00010000:1.0:1789081819.872002:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af200/0xb7cb3d7479d60d0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081819.872016:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af200/0xb7cb3d7479d60d0e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081819.872024:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af200/0xb7cb3d7479d60d0e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081819.872031:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13af200 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081819.872036:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af200/0xb7cb3d7479d60d0e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081819.872044:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af200/0xb7cb3d7479d60d0e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081819.872060:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e10d04ee300) 00010000:00010000:1.0:1789081819.872063:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789081819.872068:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af200/0xb7cb3d7479d60d0e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081819.872074:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af200/0xb7cb3d7479d60d0e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081819.872262:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796189440 00000100:00100000:3.0:1789081819.872270:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796189440 00000100:00100000:3.0:1789081819.872324:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 36 00000100:00100000:3.0:1789081819.872331:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed84e792-638e-46e0-85a3-6e17c331902b+23:14444:x1875987796189440:12345-192.168.201.17@tcp:101:dd.0 00010000:00010000:3.0:1789081819.872351:0:14123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081819.872364:0:14123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e1c00/0xb7cb3d7479d60d15 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ad5f expref: -99 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081819.872441:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e1c00/0xb7cb3d7479d60d15 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad5f expref: 24 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081819.872454:0:14123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e1c00/0xb7cb3d7479d60d15 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad5f expref: 24 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081819.872472:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e10d04ee300) 00010000:00010000:3.0:1789081819.872486:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789081819.872489:0:14123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10c29e1c00, rc 0) 00000100:00100000:3.0:1789081819.872782:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed84e792-638e-46e0-85a3-6e17c331902b+24:14444:x1875987796189440:12345-192.168.201.17@tcp:101:dd.0 Request processed in 449us (1415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081819.872790:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 36 00000100:00100000:2.0:1789081819.890228:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081819.891665:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796189696 00000100:00100000:1.0:1789081819.891677:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796189696 00000100:00100000:1.0:1789081819.891786:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 2 00000100:00100000:1.0:1789081819.891796:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed84e792-638e-46e0-85a3-6e17c331902b+24:14444:x1875987796189696:12345-192.168.201.17@tcp:103:dd.0 00010000:00010000:1.0:1789081819.891814:0:14108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789081819.891839:0:14108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e1c00/0xb7cb3d7479d60d15 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad5f expref: 24 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081819.891875:0:14108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e10d04ee300) 00010000:00010000:1.0:1789081819.891880:0:14108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789081819.891943:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed84e792-638e-46e0-85a3-6e17c331902b+23:14444:x1875987796189696:12345-192.168.201.17@tcp:103:dd.0 Request processed in 149us (1722us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081819.891951:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 2 00000100:00100000:0.0:1789081819.895016:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081819.895140:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796189824 00000100:00100000:1.0:1789081819.895150:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796189824 00000100:00100000:1.0:1789081819.895191:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 37 00000100:00100000:1.0:1789081819.895197:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c8a1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed84e792-638e-46e0-85a3-6e17c331902b+23:14444:x1875987796189824:12345-192.168.201.17@tcp:58:dd.0 00010000:00010000:1.0:1789081819.895427:0:14121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af200/0xb7cb3d7479d60d1c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081819.895440:0:14121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af200/0xb7cb3d7479d60d1c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081819.895450:0:14121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af200/0xb7cb3d7479d60d1c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789081819.896852:0:14121:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789081819.897012:0:14121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1789081819.897165:0:14121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1789081819.897388:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c8a1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed84e792-638e-46e0-85a3-6e17c331902b+23:14444:x1875987796189824:12345-192.168.201.17@tcp:58:dd.0 Request processed in 2186us (2376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081819.897398:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 37 00000100:00100000:2.0:1789081819.900501:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081819.900673:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796189952 00000100:00100000:3.0:1789081819.900683:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796189952 00000100:00100000:3.0:1789081819.900787:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 38 00000100:00100000:3.0:1789081819.900798:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed84e792-638e-46e0-85a3-6e17c331902b+23:14444:x1875987796189952:12345-192.168.201.17@tcp:101:dd.0 00010000:00010000:3.0:1789081819.900820:0:14123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081819.900840:0:14123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0600/0xb7cb3d7479d60d23 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ad66 expref: -99 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081819.900897:0:14123:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af200/0xb7cb3d7479d60d1c lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081819.900908:0:14123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0600/0xb7cb3d7479d60d23 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad66 expref: 24 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081819.900945:0:14123:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af200/0xb7cb3d7479d60d1c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081819.900958:0:14123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0600/0xb7cb3d7479d60d23 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad66 expref: 24 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081819.900969:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e10d04ee300) 00010000:00010000:3.0:1789081819.900971:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789081819.900975:0:14123:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0600/0xb7cb3d7479d60d23 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad66 expref: 24 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081819.900982:0:14123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10c29e0600, rc 0) 00000100:00100000:3.0:1789081819.901084:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed84e792-638e-46e0-85a3-6e17c331902b+24:14444:x1875987796189952:12345-192.168.201.17@tcp:101:dd.0 Request processed in 287us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081819.901102:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 38 00000100:00100000:1.0:1789081819.998599:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c8a1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821337728:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789081819.998684:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789081819.999295:0:14760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821337728 00000100:00100000:3.0:1789081819.999304:0:14760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821337728 00000100:00100000:3.0:1789081819.999420:0:14760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789081819.999430:0:14760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821337728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789081819.999489:0:14760:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789081820.001761:0:14117:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789081820.003931:0:14760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821337728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4489us (5234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081820.003949:0:14760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789081820.005814:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c8a1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821337728:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789081820.062239:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789081820.509166:0:14155:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789081820.509177:0:14155:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789081820.509217:0:14155:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789081820.509224:0:14155:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789081820.509358:0:14155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c78700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14155:1875987821337856:192.168.201.17@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789081820.509486:0:14155:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d16560c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789081820.530798:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081820.531054:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796190080 00000100:00100000:2.0:1789081820.531064:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796190080 00000100:00100000:2.0:1789081820.531118:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 0 00000100:00100000:2.0:1789081820.531128:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ed84e792-638e-46e0-85a3-6e17c331902b+25:14445:x1875987796190080:12345-192.168.201.17@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789081820.531206:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ed84e792-638e-46e0-85a3-6e17c331902b+25:14445:x1875987796190080:12345-192.168.201.17@tcp:900:lhsmtool_posix.0 Request processed in 79us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081820.531216:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 0 00000100:00080000:2.0:1789081820.531239:0:14117:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789081820.531377:0:14155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c78700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14155:1875987821337856:192.168.201.17@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789081820.546863:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081820.546965:0:15260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796190208 00000100:00100000:1.0:1789081820.546976:0:15260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796190208 00000100:00100000:1.0:1789081820.547036:0:15260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 39 00000100:00100000:1.0:1789081820.547046:0:15260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed84e792-638e-46e0-85a3-6e17c331902b+24:14445:x1875987796190208:12345-192.168.201.17@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789081820.547078:0:15260:0:(mdt_handler.c:8081:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789081820.547185:0:15260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed84e792-638e-46e0-85a3-6e17c331902b+24:14445:x1875987796190208:12345-192.168.201.17@tcp:53:lhsmtool_posix.0 Request processed in 139us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081820.547193:0:15260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 39 00000100:00100000:3.0:1789081820.552101:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081820.552195:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796190336 00000100:00100000:1.0:1789081820.552205:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796190336 00000100:00100000:1.0:1789081820.552267:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 40 00000100:00100000:1.0:1789081820.552278:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed84e792-638e-46e0-85a3-6e17c331902b+24:14445:x1875987796190336:12345-192.168.201.17@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789081820.552353:0:14122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d60d2a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.552370:0:14122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d60d2a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.552384:0:14122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d60d2a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.552415:0:14122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d60d31 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.552440:0:14122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d60d31 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.552447:0:14122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d60d31 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.552483:0:14122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d60d38 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.552492:0:14122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d60d38 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.552499:0:14122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d60d38 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789081820.552559:0:14122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789081820.552563:0:14122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789081820.552577:0:14122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d60d38 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.552588:0:14122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d60d2a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.552595:0:14122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d60d2a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.552602:0:14122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d60d2a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.552618:0:14122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13aee00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081820.552623:0:14122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d60d2a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.552629:0:14122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d60d2a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.552641:0:14122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e10c9a92600) 00010000:00010000:1.0:1789081820.552645:0:14122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789081820.552649:0:14122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d60d2a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.552655:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13aee00/0xb7cb3d7479d60d2a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.552669:0:14122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d60d31 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.552675:0:14122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d60d31 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.552681:0:14122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d60d31 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.552686:0:14122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13af400 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081820.552689:0:14122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d60d31 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.552695:0:14122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d60d31 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.552714:0:14122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9e10c7ecf700) 00010000:00010000:1.0:1789081820.552717:0:14122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789081820.552721:0:14122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d60d31 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.552727:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af400/0xb7cb3d7479d60d31 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.552742:0:14122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d60d38 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.552748:0:14122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d60d38 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.552754:0:14122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d60d38 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.552758:0:14122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081820.552761:0:14122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d60d38 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.552767:0:14122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d60d38 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.552774:0:14122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e10d04ee300) 00010000:00010000:1.0:1789081820.552776:0:14122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789081820.552779:0:14122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d60d38 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.552785:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998600/0xb7cb3d7479d60d38 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081820.552870:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed84e792-638e-46e0-85a3-6e17c331902b+24:14445:x1875987796190336:12345-192.168.201.17@tcp:34:lhsmtool_posix.0 Request processed in 593us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081820.552879:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 40 00000100:00100000:1.0:1789081820.559212:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081820.560206:0:15260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796190592 00000100:00100000:2.0:1789081820.560233:0:15260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796190592 00000100:00100000:2.0:1789081820.560313:0:15260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 41 00000100:00100000:2.0:1789081820.560325:0:15260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed84e792-638e-46e0-85a3-6e17c331902b+24:14445:x1875987796190592:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789081820.560347:0:15260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789081820.560370:0:15260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60d3f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ad6d expref: -99 pid: 15260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081820.560806:0:15260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775200/0xb7cb3d7479d60d46 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081820.560826:0:15260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775200/0xb7cb3d7479d60d46 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081820.560838:0:15260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775200/0xb7cb3d7479d60d46 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789081820.560851:0:15260:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789081820.560986:0:15260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775200/0xb7cb3d7479d60d46 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081820.561007:0:15260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775200/0xb7cb3d7479d60d46 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081820.561013:0:15260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775200/0xb7cb3d7479d60d46 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081820.561018:0:15260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101775200 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081820.561023:0:15260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775200/0xb7cb3d7479d60d46 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081820.561029:0:15260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775200/0xb7cb3d7479d60d46 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081820.561041:0:15260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e10d04ee300) 00010000:00010000:2.0:1789081820.561044:0:15260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789081820.561048:0:15260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775200/0xb7cb3d7479d60d46 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081820.561054:0:15260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775200/0xb7cb3d7479d60d46 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081820.563041:0:15260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60d3f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad6d expref: 26 pid: 15260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081820.563062:0:15260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e10c9a92600) 00010000:00010000:2.0:1789081820.563065:0:15260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789081820.563070:0:15260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101774c00/0xb7cb3d7479d60d3f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad6d expref: 26 pid: 15260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081820.566676:0:15260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101774c00, rc 0) 00000100:00100000:3.0:1789081820.566934:0:15260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed84e792-638e-46e0-85a3-6e17c331902b+25:14445:x1875987796190592:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 6606us (7727us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1789081820.566945:0:15260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 41 00000100:00100000:1.0:1789081820.580228:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081820.580298:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796190720 00000100:00100000:2.0:1789081820.580320:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796190720 00000100:00100000:2.0:1789081820.580381:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 42 00000100:00100000:2.0:1789081820.580392:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed84e792-638e-46e0-85a3-6e17c331902b+25:14445:x1875987796190720:12345-192.168.201.17@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789081820.580428:0:14122:0:(mdt_handler.c:8081:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789081820.580580:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed84e792-638e-46e0-85a3-6e17c331902b+25:14445:x1875987796190720:12345-192.168.201.17@tcp:53:lhsmtool_posix.0 Request processed in 188us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081820.580588:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 42 00000100:00100000:3.0:1789081820.587105:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081820.587154:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796190976 00000100:00100000:3.0:1789081820.587163:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796190976 00000100:00100000:3.0:1789081820.587220:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 43 00000100:00100000:3.0:1789081820.587230:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed84e792-638e-46e0-85a3-6e17c331902b+25:14445:x1875987796190976:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789081820.587251:0:14121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789081820.587279:0:14121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0000/0xb7cb3d7479d60d54 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ad74 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789081820.592682:0:14121:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:3.0:1789081820.592697:0:14121:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:3.0:1789081820.592757:0:14121:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:3.0:1789081820.593132:0:14121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0400/0xb7cb3d7479d60d5b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.593150:0:14121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0400/0xb7cb3d7479d60d5b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.593163:0:14121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0400/0xb7cb3d7479d60d5b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.594772:0:14121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0000/0xb7cb3d7479d60d54 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad74 expref: 28 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.594808:0:14121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0400/0xb7cb3d7479d60d5b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad74 expref: 27 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.594841:0:14121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e10d04eee00) 00010000:00010000:3.0:1789081820.594845:0:14121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789081820.594850:0:14121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e10c29e0400, rc 0) 00000100:00100000:3.0:1789081820.594942:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed84e792-638e-46e0-85a3-6e17c331902b+27:14445:x1875987796190976:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 7711us (7844us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1789081820.594951:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 43 00000100:00100000:1.0:1789081820.608872:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081820.608930:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796191232 00000100:00100000:3.0:1789081820.608941:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796191232 00000100:00100000:3.0:1789081820.608998:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 44 00000100:00100000:3.0:1789081820.609009:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed84e792-638e-46e0-85a3-6e17c331902b+27:14445:x1875987796191232:12345-192.168.201.17@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789081820.609075:0:14122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081820.609105:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0400/0xb7cb3d7479d60d5b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad74 expref: 27 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.609125:0:14122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e10d04eee00) 00010000:00010000:3.0:1789081820.609137:0:14122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789081820.609163:0:14122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e1c00/0xb7cb3d7479d60d69 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.609177:0:14122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e1c00/0xb7cb3d7479d60d69 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.609188:0:14122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e1c00/0xb7cb3d7479d60d69 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.609248:0:14122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60d70 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x20fbaa67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.609278:0:14122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60d70 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x20fbaa67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.609286:0:14122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60d70 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x20fbaa67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.609623:0:14122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e1c00/0xb7cb3d7479d60d69 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.609633:0:14122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e1c00/0xb7cb3d7479d60d69 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.609640:0:14122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e1c00/0xb7cb3d7479d60d69 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.609646:0:14122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10c29e1c00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081820.609651:0:14122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e1c00/0xb7cb3d7479d60d69 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.609659:0:14122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e1c00/0xb7cb3d7479d60d69 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.609670:0:14122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e10d04eef00) 00010000:00010000:3.0:1789081820.609674:0:14122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081820.609678:0:14122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e1c00/0xb7cb3d7479d60d69 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.609686:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e1c00/0xb7cb3d7479d60d69 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.609696:0:14122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60d70 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x20fbaa67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.609711:0:14122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60d70 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x20fbaa67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.609718:0:14122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60d70 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x20fbaa67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.609726:0:14122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10c29e0c00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081820.609730:0:14122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60d70 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x20fbaa67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.609737:0:14122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60d70 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x20fbaa67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.609746:0:14122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x20fbaa67 (ffff9e10d04eed00) 00010000:00010000:3.0:1789081820.609749:0:14122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789081820.609752:0:14122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60d70 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x20fbaa67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.609758:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60d70 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x20fbaa67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081820.610199:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed84e792-638e-46e0-85a3-6e17c331902b+26:14445:x1875987796191232:12345-192.168.201.17@tcp:36:lhsmtool_posix.0 Request processed in 1189us (1333us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789081820.610208:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 44 00000100:00100000:3.0:1789081820.617967:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081820.619318:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796191360 00000100:00100000:0.0:1789081820.619334:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796191360 00000100:00100000:0.0:1789081820.619409:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 45 00000100:00100000:0.0:1789081820.619432:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed84e792-638e-46e0-85a3-6e17c331902b+26:14445:x1875987796191360:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789081820.619455:0:14121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081820.619488:0:14121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d60d77 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ad7b expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081820.619546:0:14121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d60d7e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081820.619559:0:14121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d60d7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081820.619570:0:14121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d60d7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081820.619669:0:14121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d60d77 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad7b expref: 28 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081820.619689:0:14121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983400/0xb7cb3d7479d60d7e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad7b expref: 27 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081820.619697:0:14121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e10c52f5f00) 00010000:00010000:0.0:1789081820.619701:0:14121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789081820.619704:0:14121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101983400, rc 0) 00000100:00100000:0.0:1789081820.619761:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed84e792-638e-46e0-85a3-6e17c331902b+27:14445:x1875987796191360:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 343us (1806us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081820.619776:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 45 00000100:00100000:0.0:1789081820.630276:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000001:00080000:1.0:1789081820.630573:0:5811:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934606 is committed 00000001:00080000:1.0:1789081820.630593:0:5811:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000100:00100000:3.0:1789081820.630811:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796191616 00000100:00100000:3.0:1789081820.630821:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796191616 00000100:00100000:3.0:1789081820.630895:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 46 00000100:00100000:3.0:1789081820.630906:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c8a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed84e792-638e-46e0-85a3-6e17c331902b+21:14445:x1875987796191616:12345-192.168.201.17@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789081820.631001:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60d85 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.631017:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60d85 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.631030:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60d85 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789081820.631285:0:5811:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934610 is committed 00000001:00080000:1.0:1789081820.631315:0:5811:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000040:00080000:3.0:1789081820.632021:0:14123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:3.0:1789081820.632033:0:14123:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 487514508223ns, next at 488514505566ns, rc = 0 00000004:00010000:3.0:1789081820.632251:0:14123:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000ff7985c reply state 000000004df53b8f transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60d85 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081820.632262:0:14123:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789081820.632942:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c8a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed84e792-638e-46e0-85a3-6e17c331902b+16:14445:x1875987796191616:12345-192.168.201.17@tcp:36:lhsmtool_posix.0 Request processed in 2032us (2671us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1789081820.632951:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 46 00000100:00100000:2.0:1789081820.644851:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00010000:00010000:3.0:1789081820.644931:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60d85 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.644944:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60d85 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.644952:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60d85 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.644968:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10c29e0c00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081820.644973:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60d85 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.644999:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60d85 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.645016:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e10c52f5f00) 00010000:00010000:3.0:1789081820.645019:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789081820.645025:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60d85 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.645032:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60d85 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081820.646854:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796191744 00000100:00100000:0.0:1789081820.646872:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796191744 00000100:00100000:0.0:1789081820.647074:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 47 00000100:00100000:0.0:1789081820.647098:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed84e792-638e-46e0-85a3-6e17c331902b+15:14445:x1875987796191744:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789081820.647127:0:14121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789081820.647152:0:14121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d60d8c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ad82 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081820.647214:0:14121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d60d8c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad82 expref: 16 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081820.647231:0:14121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d60d8c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad82 expref: 16 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081820.647250:0:14121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e10c52f5f00) 00010000:00010000:0.0:1789081820.647253:0:14121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789081820.647257:0:14121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101983600, rc 0) 00000100:00100000:0.0:1789081820.647339:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed84e792-638e-46e0-85a3-6e17c331902b+16:14445:x1875987796191744:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 245us (2497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081820.647347:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 47 00000100:00100000:1.0:1789081820.651192:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081820.651869:0:14758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796191872 00000100:00100000:3.0:1789081820.651884:0:14758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796191872 00000100:00080000:2.0:1789081820.651955:0:14117:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789081820.651963:0:14758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 11 00000100:00100000:3.0:1789081820.651974:0:14758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed84e792-638e-46e0-85a3-6e17c331902b+5:2350:x1875987796191872:12345-192.168.201.17@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789081820.655454:0:14758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed84e792-638e-46e0-85a3-6e17c331902b+6:2350:x1875987796191872:12345-192.168.201.17@tcp:2:lhsmtool_posix.0 Request processed in 3472us (4259us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789081820.655480:0:14758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 11 00000100:00100000:2.0:1789081820.661879:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081820.661962:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796192128 00000100:00100000:3.0:1789081820.661973:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796192128 00000100:00100000:3.0:1789081820.662029:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 9 00000100:00100000:3.0:1789081820.662038:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed84e792-638e-46e0-85a3-6e17c331902b+16:14445:x1875987796192128:12345-192.168.201.17@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789081820.662675:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed84e792-638e-46e0-85a3-6e17c331902b+17:14445:x1875987796192128:12345-192.168.201.17@tcp:35:lhsmtool_posix.0 Request processed in 634us (801us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1789081820.662686:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 9 00000100:00100000:1.0:1789081820.665685:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081820.665778:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796192384 00000100:00100000:0.0:1789081820.665788:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796192384 00000100:00100000:0.0:1789081820.665850:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 48 00000100:00100000:0.0:1789081820.665860:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed84e792-638e-46e0-85a3-6e17c331902b+17:14445:x1875987796192384:12345-192.168.201.17@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789081820.665987:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed84e792-638e-46e0-85a3-6e17c331902b+17:14445:x1875987796192384:12345-192.168.201.17@tcp:57:lhsmtool_posix.0 Request processed in 128us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081820.665995:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 48 00000100:00100000:2.0:1789081820.672305:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081820.672450:0:15260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796192512 00000100:00100000:1.0:1789081820.672468:0:15260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796192512 00000100:00100000:1.0:1789081820.672564:0:15260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 49 00000100:00100000:1.0:1789081820.672575:0:15260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed84e792-638e-46e0-85a3-6e17c331902b+17:14445:x1875987796192512:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789081820.672596:0:15260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081820.672619:0:15260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998a00/0xb7cb3d7479d60d93 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ad89 expref: -99 pid: 15260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.672696:0:15260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d60d9a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.672712:0:15260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d60d9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.672723:0:15260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d60d9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789081820.672782:0:15260:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789081820.672802:0:15260:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d60d9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15260 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.672831:0:15260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998a00/0xb7cb3d7479d60d93 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad89 expref: 19 pid: 15260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.672850:0:15260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d60d9a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad89 expref: 18 pid: 15260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.672859:0:15260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e10c52f5f00) 00010000:00010000:1.0:1789081820.672862:0:15260:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789081820.672866:0:15260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101998800, rc 0) 00000100:00100000:1.0:1789081820.672923:0:15260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed84e792-638e-46e0-85a3-6e17c331902b+18:14445:x1875987796192512:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 350us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081820.672930:0:15260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 49 00000100:00100000:2.0:1789081820.681725:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081820.681939:0:14759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796192640 00000100:00100000:1.0:1789081820.681949:0:14759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796192640 00000100:00100000:1.0:1789081820.682011:0:14759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 12 00000100:00100000:1.0:1789081820.682021:0:14759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed84e792-638e-46e0-85a3-6e17c331902b+6:2351:x1875987796192640:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789081820.682041:0:14759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789081820.682064:0:14759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7aa690f/0xb7cb3d7479d60da1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x65cc21acb7c2ad90 expref: -99 pid: 14759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789081820.682104:0:14759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa338dc, blocks: 0x1 00010000:00010000:1.0:1789081820.682127:0:14759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1789081820.682147:0:14759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789081820.682158:0:14759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7aa690f/0xb7cb3d7479d60da1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad90 expref: 7 pid: 14759 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.682180:0:14759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b7aa690f/0xb7cb3d7479d60da1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad90 expref: 7 pid: 14759 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.682196:0:14759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e1101998a00, rc 0) 00000100:00100000:1.0:1789081820.682268:0:14759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed84e792-638e-46e0-85a3-6e17c331902b+7:2351:x1875987796192640:12345-192.168.201.17@tcp:101:lhsmtool_posix.0 Request processed in 240us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081820.682275:0:14759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 12 00000100:00100000:2.0:1789081820.695400:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081820.695562:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796192896 00000100:00100000:0.0:1789081820.695573:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796192896 00000100:00100000:0.0:1789081820.695634:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 50 00000100:00100000:0.0:1789081820.695644:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d0ef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed84e792-638e-46e0-85a3-6e17c331902b+18:14445:x1875987796192896:12345-192.168.201.17@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789081820.695759:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d0ef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed84e792-638e-46e0-85a3-6e17c331902b+18:14445:x1875987796192896:12345-192.168.201.17@tcp:57:lhsmtool_posix.0 Request processed in 116us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081820.695768:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 50 00000100:00100000:2.0:1789081820.702707:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081820.702805:0:15260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796193024 00000100:00100000:1.0:1789081820.702815:0:15260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796193024 00000100:00100000:1.0:1789081820.702877:0:15260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 51 00000100:00100000:1.0:1789081820.702887:0:15260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed84e792-638e-46e0-85a3-6e17c331902b+18:14445:x1875987796193024:12345-192.168.201.17@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789081820.746048:0:5811:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934611 is committed 00000001:00080000:1.0:1789081820.746069:0:5811:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1789081820.746087:0:5811:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1789081820.746340:0:15260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed84e792-638e-46e0-85a3-6e17c331902b+14:14445:x1875987796193024:12345-192.168.201.17@tcp:44:lhsmtool_posix.0 Request processed in 43448us (43637us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081820.746352:0:15260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 51 00000100:00100000:1.0:1789081820.749026:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789081820.749050:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c8a1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821337984:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789081820.749131:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081820.749346:0:14758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821337984 00000100:00100000:0.0:1789081820.749354:0:14758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821337984 00000100:00100000:0.0:1789081820.749401:0:14758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789081820.749412:0:14758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875987821337984:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789081820.749623:0:14758:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789081820.749627:0:14758:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1789081820.749629:0:14758:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789081820.749631:0:14758:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789081820 -> 1789081820 00002000:00010000:0.0:1789081820.749633:0:14758:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789081820.749678:0:14758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1875987821337984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 267us (546us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1789081820.749686:0:14758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:00080000:0.0:1789081820.749727:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e10c8a1fb80/2, rc 0, transno 8589934595 00000100:00100000:0.0:1789081820.749733:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c8a1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875987821337984:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789081820.751217:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081820.751357:0:14756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796193152 00000100:00100000:0.0:1789081820.751379:0:14756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796193152 00000100:00100000:0.0:1789081820.751432:0:14756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 14 00000100:00100000:0.0:1789081820.751442:0:14756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed84e792-638e-46e0-85a3-6e17c331902b+7:2351:x1875987796193152:12345-192.168.201.17@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789081820.751583:0:14756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed84e792-638e-46e0-85a3-6e17c331902b+7:2351:x1875987796193152:12345-192.168.201.17@tcp:16:lhsmtool_posix.0 Request processed in 142us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081820.751591:0:14756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 14 00000100:00100000:1.0:1789081820.754612:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081820.754703:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796193408 00000100:00100000:0.0:1789081820.754715:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796193408 00000100:00100000:0.0:1789081820.754784:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 52 00000100:00100000:0.0:1789081820.754793:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed84e792-638e-46e0-85a3-6e17c331902b+14:14445:x1875987796193408:12345-192.168.201.17@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789081820.754850:0:14122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789081820.754882:0:14122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101998800/0xb7cb3d7479d60d9a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad89 expref: 14 pid: 15260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081820.754901:0:14122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e10c52f5f00) 00010000:00010000:0.0:1789081820.754907:0:14122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789081820.754939:0:14122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60da8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081820.754952:0:14122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60da8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081820.754962:0:14122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60da8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789081820.755221:0:14122:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f8b182af reply state 00000000c5ea4ccd transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60da8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081820.755232:0:14122:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789081820.755405:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed84e792-638e-46e0-85a3-6e17c331902b+15:14445:x1875987796193408:12345-192.168.201.17@tcp:36:lhsmtool_posix.0 Request processed in 613us (802us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1789081820.755413:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 52 00010000:00010000:2.0:1789081820.759159:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60da8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081820.759178:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60da8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081820.759199:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60da8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081820.759205:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101982600 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:2.0:1789081820.759210:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60da8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081820.759217:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60da8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081820.759242:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e10c52f5f00) 00010000:00010000:2.0:1789081820.759245:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789081820.759250:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60da8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081820.759256:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101982600/0xb7cb3d7479d60da8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081820.759875:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081820.759965:0:14759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796193536 00000100:00100000:2.0:1789081820.759975:0:14759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796193536 00000100:00100000:2.0:1789081820.760022:0:14759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 15 00000100:00100000:2.0:1789081820.760031:0:14759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed84e792-638e-46e0-85a3-6e17c331902b+7:2348:x1875987796193536:12345-192.168.201.17@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789081820.760246:0:14759:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789081820.760250:0:14759:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789081819 00002000:00010000:2.0:1789081820.760252:0:14759:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789081819 00002000:00010000:2.0:1789081820.760254:0:14759:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789081820 -> 1789081819 00002000:00010000:2.0:1789081820.760257:0:14759:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789081820.760326:0:14759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed84e792-638e-46e0-85a3-6e17c331902b+8:2348:x1875987796193536:12345-192.168.201.17@tcp:2:lhsmtool_posix.0 Request processed in 296us (455us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789081820.760343:0:14759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 15 00000100:00100000:2.0:1789081820.763901:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081820.763994:0:14758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796193664 00000100:00100000:0.0:1789081820.764004:0:14758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796193664 00000100:00100000:0.0:1789081820.764097:0:14758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 16 00000100:00100000:0.0:1789081820.764108:0:14758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed84e792-638e-46e0-85a3-6e17c331902b+8:2351:x1875987796193664:12345-192.168.201.17@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789081820.764155:0:14758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000512db44/0xb7cb3d7479d60daf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081820.764173:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789081820.764177:0:14758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789081820.764182:0:14758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000512db44/0xb7cb3d7479d60daf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081820.764195:0:14758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000512db44/0xb7cb3d7479d60daf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081820.764236:0:14758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000512db44/0xb7cb3d7479d60daf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081820.764245:0:14758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000512db44/0xb7cb3d7479d60daf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081820.764254:0:14758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000512db44/0xb7cb3d7479d60daf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081820.764289:0:14758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101983000 already unused, calling callback (ffffffffc1784220) 00010000:00010000:0.0:1789081820.764293:0:14758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000512db44/0xb7cb3d7479d60daf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081820.764303:0:14758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000512db44/0xb7cb3d7479d60daf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081820.764318:0:14758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000512db44/0xb7cb3d7479d60daf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081820.764326:0:14758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000512db44/0xb7cb3d7479d60daf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081820.764401:0:14758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed84e792-638e-46e0-85a3-6e17c331902b+8:2351:x1875987796193664:12345-192.168.201.17@tcp:1:lhsmtool_posix.0 Request processed in 295us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789081820.764410:0:14758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 16 00000100:00100000:1.0:1789081820.767606:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081820.767695:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796193920 00000100:00100000:3.0:1789081820.767706:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796193920 00000100:00100000:3.0:1789081820.767769:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 53 00000100:00100000:3.0:1789081820.767779:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed84e792-638e-46e0-85a3-6e17c331902b+14:14445:x1875987796193920:12345-192.168.201.17@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789081820.767897:0:14121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60db6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.767915:0:14121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60db6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.767927:0:14121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60db6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.768195:0:14121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e1c00/0xb7cb3d7479d60dbd lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.768205:0:14121:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d60d8c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad82 expref: 15 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.768213:0:14121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e1c00/0xb7cb3d7479d60dbd lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.768247:0:14121:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d60d8c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad82 expref: 15 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.768274:0:14121:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d60d8c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad82 expref: 15 pid: 14121 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081820.768292:0:14121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5dda680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14121:1875987821338112:192.168.201.17@tcp:104: 00000100:00100000:3.0:1789081820.768518:0:14121:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d0dbd840 going to sleep for 11 seconds 00000100:00100000:3.0:1789081820.772284:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081820.772424:0:14121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5dda680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14121:1875987821338112:192.168.201.17@tcp:104: 00010000:00010000:0.0:1789081820.772452:0:14121:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e1c00/0xb7cb3d7479d60dbd lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081820.772568:0:16132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796194048 00000100:00100000:2.0:1789081820.772576:0:16132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796194048 00010000:00010000:2.0:1789081820.772614:0:16132:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d60d8c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad82 expref: 16 pid: 14121 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081820.772647:0:16132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 13 00000100:00100000:2.0:1789081820.772655:0:16132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed84e792-638e-46e0-85a3-6e17c331902b+16:2350:x1875987796194048:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789081820.772670:0:16132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789081820.772676:0:16132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d60d8c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad82 expref: 16 pid: 14121 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081820.772688:0:16132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d60d8c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad82 expref: 16 pid: 14121 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081820.772710:0:16132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101983600/0xb7cb3d7479d60d8c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad82 expref: 16 pid: 14121 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081820.772725:0:16132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e10c52f5f00) 00010000:00010000:2.0:1789081820.772730:0:16132:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e1c00/0xb7cb3d7479d60dbd lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081820.772741:0:16132:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e1c00/0xb7cb3d7479d60dbd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081820.772748:0:16132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e1c00/0xb7cb3d7479d60dbd lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081820.772787:0:16132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789081820.772832:0:16132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed84e792-638e-46e0-85a3-6e17c331902b+15:2350:x1875987796194048:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 177us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081820.772840:0:16132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 13 00010000:00010000:0.0:1789081820.772909:0:14121:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e1c00/0xb7cb3d7479d60dbd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081820.772917:0:14121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e1c00/0xb7cb3d7479d60dbd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789081820.773131:0:14121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1789081820.773299:0:14121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1789081820.773345:0:14121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1789081820.773426:0:14121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10c8a1e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14121:1875987821338240:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789081820.773514:0:14121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789081820.773573:0:14121:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d0f18180 going to sleep for 11 seconds 00000100:00100000:2.0:1789081820.774001:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821338240 00000100:00100000:2.0:1789081820.774008:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821338240 00000100:00100000:2.0:1789081820.774049:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789081820.774058:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10c8a1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14121:x1875987821338240:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789081820.774148:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10c8a1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14121:x1875987821338240:12345-0@lo:1000:mdt00_000.0 Request processed in 92us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081820.774156:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789081820.774233:0:14121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10c8a1e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14121:1875987821338240:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1789081820.774932:0:14121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1789081820.775006:0:14121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c79c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14121:1875987821338368:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789081820.775057:0:14121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081820.775080:0:14121:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d03dcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789081820.775423:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821338368 00000100:00100000:2.0:1789081820.775429:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821338368 00000100:00100000:2.0:1789081820.775470:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789081820.775480:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14121:x1875987821338368:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789081820.775668:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14121:x1875987821338368:12345-0@lo:1000:mdt00_000.0 Request processed in 189us (610us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789081820.775676:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789081820.775861:0:14121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c79c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14121:1875987821338368:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1789081820.775892:0:14121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e1c00/0xb7cb3d7479d60dbd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.775907:0:14121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e1c00/0xb7cb3d7479d60dbd lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.775914:0:14121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e1c00/0xb7cb3d7479d60dbd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.775920:0:14121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10c29e1c00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081820.775924:0:14121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e1c00/0xb7cb3d7479d60dbd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.775932:0:14121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e1c00/0xb7cb3d7479d60dbd lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.775947:0:14121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e10c52f5f00) 00010000:00010000:3.0:1789081820.775950:0:14121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789081820.775954:0:14121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e1c00/0xb7cb3d7479d60dbd lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.775960:0:14121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e1c00/0xb7cb3d7479d60dbd lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.775990:0:14121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af200/0xb7cb3d7479d60d1c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.775997:0:14121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af200/0xb7cb3d7479d60d1c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.776003:0:14121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af200/0xb7cb3d7479d60d1c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.776007:0:14121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10e13af200 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:3.0:1789081820.776016:0:14121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af200/0xb7cb3d7479d60d1c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.776021:0:14121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af200/0xb7cb3d7479d60d1c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.776029:0:14121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e10d04ee300) 00010000:00010000:3.0:1789081820.776031:0:14121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789081820.776037:0:14121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0600/0xb7cb3d7479d60d23 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad66 expref: 18 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.776047:0:14121:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0600/0xb7cb3d7479d60d23 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad66 expref: 18 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.776056:0:14121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0600/0xb7cb3d7479d60d23 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad66 expref: 18 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.776105:0:14121:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0600/0xb7cb3d7479d60d23 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad66 expref: 18 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081820.776118:0:14121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5dd9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14121:1875987821338496:192.168.201.17@tcp:105: 00000100:00100000:3.0:1789081820.776190:0:14121:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10d0dbd840 going to sleep for 11 seconds 00000100:00100000:3.0:1789081820.780761:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081820.780890:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796194176 00000100:00100000:2.0:1789081820.780899:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796194176 00000100:00100000:2.0:1789081820.780951:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 10 00000100:00100000:2.0:1789081820.780961:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10ff65f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed84e792-638e-46e0-85a3-6e17c331902b+19:14444:x1875987796194176:12345-192.168.201.17@tcp:49:dd.0 00000100:00100000:2.0:1789081820.781152:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10ff65f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed84e792-638e-46e0-85a3-6e17c331902b+19:14444:x1875987796194176:12345-192.168.201.17@tcp:49:dd.0 Request processed in 192us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081820.781161:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 10 00000100:00100000:1.0:1789081820.781849:0:14121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5dd9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14121:1875987821338496:192.168.201.17@tcp:105: 00010000:00010000:1.0:1789081820.781874:0:14121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af200/0xb7cb3d7479d60d1c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.781884:0:14121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10e13af200/0xb7cb3d7479d60d1c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.781916:0:14121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999a00/0xb7cb3d7479d60dc4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.781930:0:14121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999a00/0xb7cb3d7479d60dc4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.781940:0:14121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999a00/0xb7cb3d7479d60dc4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.781949:0:14121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999a00/0xb7cb3d7479d60dc4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.781955:0:14121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999a00/0xb7cb3d7479d60dc4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.781961:0:14121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999a00/0xb7cb3d7479d60dc4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.781966:0:14121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999a00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081820.781970:0:14121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999a00/0xb7cb3d7479d60dc4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.781990:0:14121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999a00/0xb7cb3d7479d60dc4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.782001:0:14121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e10d04ee300) 00010000:00010000:1.0:1789081820.782003:0:14121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789081820.782007:0:14121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999a00/0xb7cb3d7479d60dc4 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.782012:0:14121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101999a00/0xb7cb3d7479d60dc4 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.782020:0:14121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60db6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.782025:0:14121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60db6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.782030:0:14121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60db6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.782035:0:14121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e10c29e0c00 already unused, calling callback (ffffffffc21934f0) 00010000:00010000:1.0:1789081820.782038:0:14121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60db6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.782043:0:14121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60db6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.782050:0:14121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e10d04ee300) 00010000:00010000:1.0:1789081820.782052:0:14121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789081820.782055:0:14121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60db6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.782070:0:14121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e10c29e0c00/0xb7cb3d7479d60db6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081820.782862:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed84e792-638e-46e0-85a3-6e17c331902b+18:14445:x1875987796193920:12345-192.168.201.17@tcp:57:lhsmtool_posix.0 Request processed in 15080us (15262us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1789081820.782874:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 53 00000020:00080000:1.0:1789081820.782879:0:14121:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789081820.789566:0:14155:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789081820.789576:0:14155:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789081820.789611:0:14155:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789081820.789618:0:14155:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789081820.791701:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081820.791883:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796194432 00000100:00100000:2.0:1789081820.791895:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796194432 00000100:00100000:2.0:1789081820.791958:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 11 00000100:00100000:2.0:1789081820.791968:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5ddb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed84e792-638e-46e0-85a3-6e17c331902b+18:14445:x1875987796194432:12345-192.168.201.17@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789081820.792647:0:14125:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789081820.792740:0:14125:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1789081820.792786:0:14125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775400/0xb7cb3d7479d60dcb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081820.792804:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775400/0xb7cb3d7479d60dcb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081820.792817:0:14125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775400/0xb7cb3d7479d60dcb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081820.792826:0:14125:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775400/0xb7cb3d7479d60dcb lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081820.792831:0:14125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775400/0xb7cb3d7479d60dcb lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081820.792837:0:14125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775400/0xb7cb3d7479d60dcb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081820.792860:0:14125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789081820.792950:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5ddb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed84e792-638e-46e0-85a3-6e17c331902b+20:14445:x1875987796194432:12345-192.168.201.17@tcp:35:lhsmtool_posix.0 Request processed in 983us (1258us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1789081820.792968:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 11 00000020:00080000:2.0:1789081820.792973:0:14125:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789081820.793196:0:14109:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789081820.793204:0:14109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775400/0xb7cb3d7479d60dcb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.793211:0:14109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101775400 already unused, calling callback (ffffffffc1784220) 00010000:00010000:1.0:1789081820.793215:0:14109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775400/0xb7cb3d7479d60dcb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.793222:0:14109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775400/0xb7cb3d7479d60dcb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.793237:0:14109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e10c52f5f00) 00010000:00010000:1.0:1789081820.793240:0:14109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789081820.793245:0:14109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775400/0xb7cb3d7479d60dcb lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.793251:0:14109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e1101775400/0xb7cb3d7479d60dcb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.793265:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081820.793267:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789081820.793268:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081820.989799:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081820.989853:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081820.989884:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:1.0:1789081820.990264:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796194560 00000100:00100000:1.0:1789081820.990287:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796194560 00000100:00100000:1.0:1789081820.990340:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796194688 00000100:00100000:1.0:1789081820.990343:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796194688 00000100:00100000:1.0:1789081820.990359:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796194816 00000100:00100000:1.0:1789081820.990362:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796194816 00000100:00100000:1.0:1789081820.990382:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 0 00000100:00100000:1.0:1789081820.990391:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ed84e792-638e-46e0-85a3-6e17c331902b+10:2350:x1875987796194560:12345-192.168.201.17@tcp:4:dd.0 00010000:00010000:1.0:1789081820.990427:0:14764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e192ea07/0xb7cb3d7479d60dd2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.990449:0:14764:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b7aa690f/0xb7cb3d7479d60da1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad90 expref: 10 pid: 14759 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.990469:0:14764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789081820.990473:0:14764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789081820.990479:0:14764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e192ea07/0xb7cb3d7479d60dd2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.990515:0:14764:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b7aa690f/0xb7cb3d7479d60da1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad90 expref: 10 pid: 14759 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.990559:0:14764:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b7aa690f/0xb7cb3d7479d60da1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad90 expref: 10 pid: 14759 timeout: 587 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081820.990576:0:14764:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c79880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:14764:1875987821338624:192.168.201.17@tcp:104: 00000100:00100000:1.0:1789081820.990667:0:14764:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e10c133a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789081820.991765:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081820.991806:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:0.0:1789081820.991880:0:14763:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1789081820.991889:0:14763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1789081820.991950:0:14762:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789081820.991963:0:14762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796195072 00000100:00100000:3.0:1789081820.991980:0:14762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796195072 00000100:00100000:3.0:1789081820.992020:0:14762:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789081820.992026:0:14762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796194944 00000100:00100000:3.0:1789081820.992028:0:14762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796194944 00000100:00100000:0.0:1789081820.992848:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 1 00000100:00100000:0.0:1789081820.992861:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ed84e792-638e-46e0-85a3-6e17c331902b+12:2350:x1875987796194688:12345-192.168.201.17@tcp:4:dd.0 00010000:00010000:0.0:1789081820.992899:0:16245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000512db44/0xb7cb3d7479d60dd9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081820.992915:0:16245:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789081820.992920:0:16245:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789081820.992925:0:16245:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000512db44/0xb7cb3d7479d60dd9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081820.992935:0:16245:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000512db44/0xb7cb3d7479d60dd9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081820.994939:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081820.994984:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081820.995012:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:2.0:1789081820.995223:0:14762:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1789081820.995234:0:14762:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1789081820.995715:0:14762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796195200 00000100:00100000:2.0:1789081820.995725:0:14762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796195200 00000100:00100000:2.0:1789081820.995774:0:14762:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1789081820.995780:0:14762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796195328 00000100:00100000:2.0:1789081820.995783:0:14762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796195328 00000100:00100000:2.0:1789081820.995797:0:14762:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1789081820.995802:0:14762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796195456 00000100:00100000:2.0:1789081820.995804:0:14762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796195456 00000100:00100000:3.0:1789081820.995896:0:14764:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c79880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:14764:1875987821338624:192.168.201.17@tcp:104: 00010000:00010000:3.0:1789081820.995925:0:14764:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e192ea07/0xb7cb3d7479d60dd2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081820.996417:0:16246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 2 00000100:00100000:1.0:1789081820.996433:0:16246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ed84e792-638e-46e0-85a3-6e17c331902b+15:2350:x1875987796194816:12345-192.168.201.17@tcp:4:dd.0 00010000:00010000:1.0:1789081820.996480:0:16246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d60de0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.996496:0:16246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789081820.996501:0:16246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789081820.996506:0:16246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d60de0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081820.996515:0:16246:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d60de0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081820.997091:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081820.997196:0:14106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796195584 00000100:00100000:3.0:1789081820.997214:0:14106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796195584 00010000:00010000:3.0:1789081820.997339:0:14106:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b7aa690f/0xb7cb3d7479d60da1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad90 expref: 16 pid: 14759 timeout: 587 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789081820.997391:0:14106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 14 00000100:00100000:3.0:1789081820.997402:0:14106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed84e792-638e-46e0-85a3-6e17c331902b+16:2351:x1875987796195584:12345-192.168.201.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789081820.997421:0:14106:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789081820.997463:0:14106:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b7aa690f/0xb7cb3d7479d60da1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad90 expref: 16 pid: 14759 timeout: 587 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.997480:0:14106:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b7aa690f/0xb7cb3d7479d60da1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad90 expref: 16 pid: 14759 timeout: 587 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.997511:0:14106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7aa690f/0xb7cb3d7479d60da1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.17@tcp remote: 0x65cc21acb7c2ad90 expref: 16 pid: 14759 timeout: 587 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.997597:0:14106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081820.997602:0:14106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081820.997609:0:14106:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e192ea07/0xb7cb3d7479d60dd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.997621:0:14106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e192ea07/0xb7cb3d7479d60dd2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.997631:0:14106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081820.997634:0:14106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081820.997637:0:14106:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000512db44/0xb7cb3d7479d60dd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.997645:0:14106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000512db44/0xb7cb3d7479d60dd9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.997652:0:14106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081820.997654:0:14106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789081820.997658:0:14106:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d60de0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.997667:0:14106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d60de0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.997716:0:14106:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789081820.997788:0:14106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed84e792-638e-46e0-85a3-6e17c331902b+15:2351:x1875987796195584:12345-192.168.201.17@tcp:103:ldlm_bl.0 Request processed in 388us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081820.997805:0:14106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 14 00010000:00010000:3.0:1789081820.997841:0:14764:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e192ea07/0xb7cb3d7479d60dd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789081820.997850:0:14764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e192ea07/0xb7cb3d7479d60dd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081820.998379:0:16246:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d60de0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081820.998397:0:16246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d60de0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081820.999690:0:16245:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000512db44/0xb7cb3d7479d60dd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081820.999707:0:16245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000512db44/0xb7cb3d7479d60dd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081821.021270:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d0ef1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875987821339008:0@lo:400:kworker.0 00000100:00100000:2.0:1789081821.021347:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081821.021391:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789081821.021398:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5f06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875987821339136:0@lo:400:kworker.0 00000100:00100000:2.0:1789081821.021424:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789081821.021475:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821339008 00000100:00100000:2.0:1789081821.021484:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821339008 00000100:00100000:2.0:1789081821.021578:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821339136 00000100:00100000:2.0:1789081821.021584:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821339136 00000100:00100000:2.0:1789081821.021625:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789081821.021637:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875987821339008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789081821.021701:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875987821339008:12345-0@lo:400:kworker.0 Request processed in 67us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081821.021711:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789081821.021739:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789081821.021748:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5f05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875987821339136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789081821.021789:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5f05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875987821339136:12345-0@lo:400:kworker.0 Request processed in 43us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789081821.021796:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1789081821.021835:0:14117:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789081821.021870:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5f06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875987821339136:0@lo:400:kworker.0 00000100:00100000:2.0:1789081821.021881:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d0ef1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875987821339008:0@lo:400:kworker.0 00000100:00100000:1.0:1789081821.022355:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d2dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:3303:1875987821338752:0@lo:400:kworker.0 00000100:00100000:1.0:1789081821.022397:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081821.022433:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5f05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875987821339264:0@lo:400:kworker.0 00000100:00100000:1.0:1789081821.022476:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081821.022497:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789081821.022504:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10d0ef2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821338880:0@lo:400:kworker.0 00000100:00100000:1.0:1789081821.022573:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081821.022605:0:15260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821339264 00000100:00100000:1.0:1789081821.022609:0:15260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821339264 00000100:00100000:1.0:1789081821.022649:0:15260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789081821.022655:0:15260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875987821339264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081821.022691:0:15260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875987821339264:12345-0@lo:400:kworker.0 Request processed in 36us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081821.022698:0:15260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789081821.022728:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821338752 00000100:00100000:1.0:1789081821.022731:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821338752 00000100:00100000:1.0:1789081821.022767:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789081821.022774:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+19:3303:x1875987821338752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081821.022819:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0+19:3303:x1875987821338752:12345-0@lo:400:kworker.0 Request processed in 45us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081821.022825:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789081821.022854:0:14756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821338880 00000100:00100000:1.0:1789081821.022858:0:14756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821338880 00000100:00100000:1.0:1789081821.022886:0:14756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789081821.022892:0:14756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821338880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789081821.022920:0:14756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821338880:12345-0@lo:400:kworker.0 Request processed in 28us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081821.022926:0:14756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1789081821.022946:0:14117:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789081821.022950:0:14117:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789081821.022972:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d0ef2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821338880:0@lo:400:kworker.0 00000100:00100000:1.0:1789081821.022982:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10d2dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e46eaf3-dc5a-439e-b2dc-a42b5d9238c0:3303:1875987821338752:0@lo:400:kworker.0 00000100:00100000:1.0:1789081821.022991:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5f05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875987821339264:0@lo:400:kworker.0 00000100:00100000:1.0:1789081821.023462:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789081821.023473:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e10f5c7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821339392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789081821.023507:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789081821.023566:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987821339392 00000100:00100000:1.0:1789081821.023572:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987821339392 00000100:00100000:1.0:1789081821.023616:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789081821.023623:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5c79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821339392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789081821.023662:0:14761:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789081821.023716:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5c79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875987821339392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789081821.023723:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789081821.024484:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e10f5c7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875987821339392:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789081821.084797:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789081821.174294:0:16245:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:0.0:1789081821.174308:0:16245:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1789081819 -> 1789081820 00002000:00010000:0.0:1789081821.174311:0:16245:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789081819 -> 1789081820 00002000:00010000:0.0:1789081821.174313:0:16245:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:0.0:1789081821.174333:0:16245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000512db44/0xb7cb3d7479d60dd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081821.174349:0:16245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000512db44/0xb7cb3d7479d60dd9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081821.174359:0:16245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000512db44/0xb7cb3d7479d60dd9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081821.174367:0:16245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101983000 already unused, calling callback (ffffffffc1784220) 00010000:00010000:0.0:1789081821.174373:0:16245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000512db44/0xb7cb3d7479d60dd9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081821.174384:0:16245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000512db44/0xb7cb3d7479d60dd9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081821.174412:0:16245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000512db44/0xb7cb3d7479d60dd9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081821.174422:0:16245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000512db44/0xb7cb3d7479d60dd9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081821.174651:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ed84e792-638e-46e0-85a3-6e17c331902b+22:2350:x1875987796194688:12345-192.168.201.17@tcp:4:dd.0 Request processed in 181785us (184789us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1789081821.174664:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 1 00000100:00100000:0.0:1789081821.174699:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 3 00000100:00100000:0.0:1789081821.174712:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ed84e792-638e-46e0-85a3-6e17c331902b+21:2351:x1875987796195072:12345-192.168.201.17@tcp:4:dd.0 00010000:00010000:0.0:1789081821.174751:0:16245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3b87205/0xb7cb3d7479d60de7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081821.174767:0:16245:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789081821.174772:0:16245:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789081821.174779:0:16245:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3b87205/0xb7cb3d7479d60de7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081821.174793:0:16245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3b87205/0xb7cb3d7479d60de7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081821.175004:0:14764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e192ea07/0xb7cb3d7479d60dd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081821.175015:0:14764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e192ea07/0xb7cb3d7479d60dd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081821.175023:0:14764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e192ea07/0xb7cb3d7479d60dd2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081821.175043:0:14764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101999a00 already unused, calling callback (ffffffffc1784220) 00010000:00010000:2.0:1789081821.175047:0:14764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e192ea07/0xb7cb3d7479d60dd2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081821.175055:0:14764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e192ea07/0xb7cb3d7479d60dd2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081821.175066:0:14764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e192ea07/0xb7cb3d7479d60dd2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081821.175074:0:14764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e192ea07/0xb7cb3d7479d60dd2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081821.175111:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ed84e792-638e-46e0-85a3-6e17c331902b+21:2350:x1875987796194560:12345-192.168.201.17@tcp:4:dd.0 Request processed in 184721us (185322us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1789081821.175118:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 0 00000100:00100000:2.0:1789081821.175134:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 4 00000100:00100000:2.0:1789081821.175141:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ed84e792-638e-46e0-85a3-6e17c331902b+20:2351:x1875987796194944:12345-192.168.201.17@tcp:4:dd.0 00010000:00010000:2.0:1789081821.175158:0:14764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a9e5259/0xb7cb3d7479d60dee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081821.175167:0:14764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789081821.175171:0:14764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789081821.175176:0:14764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a9e5259/0xb7cb3d7479d60dee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081821.175196:0:14764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a9e5259/0xb7cb3d7479d60dee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789081821.182294:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:3.0:1789081821.182322:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:3.0:1789081821.182340:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:2.0:1789081821.250011:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:1.0:1789081821.250176:0:16246:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 5242880 00002000:00010000:1.0:1789081821.250181:0:16246:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:1.0:1789081821.250202:0:16246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d60de0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081821.250218:0:16246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d60de0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081821.250228:0:16246:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d60de0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081821.250235:0:16246:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998200 already unused, calling callback (ffffffffc1784220) 00010000:00010000:1.0:1789081821.250242:0:16246:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d60de0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081821.250262:0:16246:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d60de0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081821.250290:0:16246:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d60de0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081821.250299:0:16246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063063d14/0xb7cb3d7479d60de0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789081821.250459:0:16246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ed84e792-638e-46e0-85a3-6e17c331902b+16:2350:x1875987796194816:12345-192.168.201.17@tcp:4:dd.0 Request processed in 254011us (260557us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1789081821.250473:0:16246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 2 00000100:00100000:1.0:1789081821.250519:0:16246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 5 00000100:00100000:1.0:1789081821.250581:0:16246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ed84e792-638e-46e0-85a3-6e17c331902b+15:2350:x1875987796195200:12345-192.168.201.17@tcp:4:dd.0 00010000:00010000:1.0:1789081821.250623:0:16246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009dc56b41/0xb7cb3d7479d60df5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081821.250638:0:16246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789081821.250643:0:16246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789081821.250652:0:16246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009dc56b41/0xb7cb3d7479d60df5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789081821.250666:0:16246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009dc56b41/0xb7cb3d7479d60df5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789081821.326634:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00002000:00010000:0.0:1789081821.327195:0:16245:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:0.0:1789081821.327202:0:16245:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 10247 00010000:00010000:0.0:1789081821.327222:0:16245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3b87205/0xb7cb3d7479d60de7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081821.327238:0:16245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3b87205/0xb7cb3d7479d60de7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081821.327247:0:16245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3b87205/0xb7cb3d7479d60de7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081821.327463:0:16245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101983800 already unused, calling callback (ffffffffc1784220) 00010000:00010000:0.0:1789081821.327470:0:16245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3b87205/0xb7cb3d7479d60de7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081821.327482:0:16245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3b87205/0xb7cb3d7479d60de7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081821.327507:0:16245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3b87205/0xb7cb3d7479d60de7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081821.327515:0:16245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3b87205/0xb7cb3d7479d60de7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081821.327898:0:14764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a9e5259/0xb7cb3d7479d60dee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081821.327908:0:14764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a9e5259/0xb7cb3d7479d60dee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081821.327916:0:14764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a9e5259/0xb7cb3d7479d60dee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081821.327922:0:14764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101774400 already unused, calling callback (ffffffffc1784220) 00010000:00010000:2.0:1789081821.327926:0:14764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a9e5259/0xb7cb3d7479d60dee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081821.327934:0:14764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a9e5259/0xb7cb3d7479d60dee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081821.327945:0:14764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a9e5259/0xb7cb3d7479d60dee lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081821.327952:0:14764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a9e5259/0xb7cb3d7479d60dee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081821.330215:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ed84e792-638e-46e0-85a3-6e17c331902b+12:2351:x1875987796195072:12345-192.168.201.17@tcp:4:dd.0 Request processed in 155487us (338434us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1789081821.330234:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 3 00000100:00100000:0.0:1789081821.330295:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 6 00000100:00100000:0.0:1789081821.330316:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ed84e792-638e-46e0-85a3-6e17c331902b+11:2351:x1875987796195328:12345-192.168.201.17@tcp:4:dd.0 00010000:00010000:0.0:1789081821.330374:0:16245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4195f1e/0xb7cb3d7479d60dfc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081821.330397:0:16245:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789081821.330402:0:16245:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789081821.330411:0:16245:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4195f1e/0xb7cb3d7479d60dfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081821.330464:0:16245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4195f1e/0xb7cb3d7479d60dfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081821.331642:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ed84e792-638e-46e0-85a3-6e17c331902b+12:2351:x1875987796194944:12345-192.168.201.17@tcp:4:dd.0 Request processed in 156489us (339824us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1789081821.331658:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 4 00000100:00100000:2.0:1789081821.331698:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 7 00000100:00100000:2.0:1789081821.331711:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f5dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ed84e792-638e-46e0-85a3-6e17c331902b+11:2350:x1875987796195456:12345-192.168.201.17@tcp:4:dd.0 00010000:00010000:2.0:1789081821.331745:0:14764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c12417a1/0xb7cb3d7479d60e03 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081821.331761:0:14764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789081821.331766:0:14764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789081821.331774:0:14764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c12417a1/0xb7cb3d7479d60e03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081821.331789:0:14764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c12417a1/0xb7cb3d7479d60e03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789081821.383126:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:2.0:1789081821.383429:0:16246:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:2.0:1789081821.383435:0:16246:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:2.0:1789081821.383464:0:16246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009dc56b41/0xb7cb3d7479d60df5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081821.383481:0:16246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009dc56b41/0xb7cb3d7479d60df5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081821.383491:0:16246:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009dc56b41/0xb7cb3d7479d60df5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081821.383518:0:16246:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101998800 already unused, calling callback (ffffffffc1784220) 00010000:00010000:2.0:1789081821.383549:0:16246:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009dc56b41/0xb7cb3d7479d60df5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081821.383562:0:16246:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009dc56b41/0xb7cb3d7479d60df5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081821.383590:0:16246:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009dc56b41/0xb7cb3d7479d60df5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081821.383600:0:16246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009dc56b41/0xb7cb3d7479d60df5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081821.383773:0:16246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ed84e792-638e-46e0-85a3-6e17c331902b+13:2350:x1875987796195200:12345-192.168.201.17@tcp:4:dd.0 Request processed in 133192us (388834us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1789081821.383787:0:16246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 5 00002000:00010000:0.0:1789081821.421714:0:14764:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:0.0:1789081821.421746:0:14764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c12417a1/0xb7cb3d7479d60e03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081821.421762:0:14764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c12417a1/0xb7cb3d7479d60e03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081821.421772:0:14764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c12417a1/0xb7cb3d7479d60e03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081821.421781:0:14764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101775400 already unused, calling callback (ffffffffc1784220) 00010000:00010000:0.0:1789081821.421787:0:14764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c12417a1/0xb7cb3d7479d60e03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081821.421799:0:14764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c12417a1/0xb7cb3d7479d60e03 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081821.421825:0:14764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c12417a1/0xb7cb3d7479d60e03 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789081821.421834:0:14764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c12417a1/0xb7cb3d7479d60e03 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789081821.421976:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ed84e792-638e-46e0-85a3-6e17c331902b+11:2350:x1875987796195456:12345-192.168.201.17@tcp:4:dd.0 Request processed in 90263us (426956us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1789081821.421989:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 7 00010000:00010000:2.0:1789081821.422516:0:16245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4195f1e/0xb7cb3d7479d60dfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081821.422553:0:16245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4195f1e/0xb7cb3d7479d60dfc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081821.422562:0:16245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4195f1e/0xb7cb3d7479d60dfc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081821.422583:0:16245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e1101983200 already unused, calling callback (ffffffffc1784220) 00010000:00010000:2.0:1789081821.422587:0:16245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4195f1e/0xb7cb3d7479d60dfc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081821.422595:0:16245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4195f1e/0xb7cb3d7479d60dfc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081821.422609:0:16245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4195f1e/0xb7cb3d7479d60dfc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789081821.422617:0:16245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4195f1e/0xb7cb3d7479d60dfc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789081821.422678:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f5dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ed84e792-638e-46e0-85a3-6e17c331902b+9:2351:x1875987796195328:12345-192.168.201.17@tcp:4:dd.0 Request processed in 92373us (427692us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1789081821.422687:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 6 00000001:00080000:1.0:1789081821.424154:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00000040:00080000:1.0:1789081821.853058:0:14155:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789081821.853072:0:14155:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789081821.853112:0:14155:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789081821.853126:0:14155:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1789081822.111070:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789081823.059743:0:16284:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1789081823.136167:0:14110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789081823.192493:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081823.192604:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081823.192633:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081823.192670:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081823.192691:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081823.192711:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081823.192756:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.17@tcp (source: 12345-192.168.201.17@tcp) 00000100:00100000:3.0:1789081823.192790:0:14756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796196096 00000100:00100000:3.0:1789081823.192805:0:14756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796196096 00000100:00100000:3.0:1789081823.192880:0:14756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796196352 00000100:00100000:3.0:1789081823.192884:0:14756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796196352 00000100:00100000:3.0:1789081823.192902:0:14756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796195968 00000100:00100000:3.0:1789081823.192905:0:14756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796195968 00000100:00100000:3.0:1789081823.192921:0:14756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796196480 00000100:00100000:3.0:1789081823.192923:0:14756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796196480 00000100:00100000:3.0:1789081823.192947:0:14756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 15 00000100:00100000:3.0:1789081823.192958:0:14756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2defb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed84e792-638e-46e0-85a3-6e17c331902b+5:2351:x1875987796196096:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081823.193071:0:14756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2defb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed84e792-638e-46e0-85a3-6e17c331902b+5:2351:x1875987796196096:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 114us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081823.193094:0:14756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 15 00000100:00100000:3.0:1789081823.193119:0:14756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 16 00000100:00100000:3.0:1789081823.193125:0:14756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c6e70d6-563c-4301-b0bb-af616cc0908d+5:2351:x1875987796196352:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081823.193154:0:14756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c6e70d6-563c-4301-b0bb-af616cc0908d+5:2351:x1875987796196352:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 29us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081823.193161:0:14756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 16 00000100:00100000:3.0:1789081823.193173:0:14756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 17 00000100:00100000:3.0:1789081823.193178:0:14756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2def100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed84e792-638e-46e0-85a3-6e17c331902b+5:2351:x1875987796195968:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081823.193203:0:14756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2def100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed84e792-638e-46e0-85a3-6e17c331902b+5:2351:x1875987796195968:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 24us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081823.193209:0:14756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 17 00000100:00100000:3.0:1789081823.193219:0:14756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 18 00000100:00100000:3.0:1789081823.193226:0:14756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2deca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c6e70d6-563c-4301-b0bb-af616cc0908d+5:2351:x1875987796196480:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081823.193250:0:14756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2deca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c6e70d6-563c-4301-b0bb-af616cc0908d+5:2351:x1875987796196480:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 25us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081823.193257:0:14756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 18 00000100:00100000:3.0:1789081823.193278:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796195712 00000100:00100000:3.0:1789081823.193282:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796195712 00000100:00100000:3.0:1789081823.193310:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 123 00000100:00100000:3.0:1789081823.193317:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e1101b26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a67ef68-2159-4a6b-960e-9de3ab596c83+13:2351:x1875987796195712:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081823.193342:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e1101b26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a67ef68-2159-4a6b-960e-9de3ab596c83+13:2351:x1875987796195712:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 25us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081823.193348:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 123 00000100:00100000:3.0:1789081823.193396:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796195840 00000100:00100000:3.0:1789081823.193400:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796195840 00000100:00100000:3.0:1789081823.193451:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875987796196224 00000100:00100000:3.0:1789081823.193455:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875987796196224 00000100:00100000:3.0:1789081823.193479:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 27 00000100:00100000:3.0:1789081823.193484:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10f9b25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed84e792-638e-46e0-85a3-6e17c331902b+20:2351:x1875987796195840:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081823.193519:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10f9b25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed84e792-638e-46e0-85a3-6e17c331902b+20:2351:x1875987796195840:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 34us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081823.193562:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 27 00000100:00100000:3.0:1789081823.193575:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.17@tcp, seq: 28 00000100:00100000:3.0:1789081823.193582:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e10d2dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c6e70d6-563c-4301-b0bb-af616cc0908d+6:2351:x1875987796196224:12345-192.168.201.17@tcp:400:kworker.0 00000100:00100000:3.0:1789081823.193613:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e10d2dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c6e70d6-563c-4301-b0bb-af616cc0908d+6:2351:x1875987796196224:12345-192.168.201.17@tcp:400:kworker.0 Request processed in 31us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1789081823.193619:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.17@tcp, seq: 28 00000100:00080000:3.0:1789081823.193639:0:14117:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789081823.193644:0:14117:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789081823.193647:0:14117:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789081824.161507:0:14109:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29420 lines, 29420 kept, 0 dropped, 0 bad.